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ABSTRACT 


The  definition  of  several  new  system  functions  leads  to  a  more 
complete  characterization  of  time -varying  linear  systems.  A  family 
of  twelve  system  functions,  including  the  impul se  -  r espons e  K  system 
functions,  are  used  to  describe  time-varying  linear  systems.  The  re¬ 
lationships  among  the  various  system  functions  are  clearly  illustrated. 
The  K  system  functions  are  shown  to  be  convenient  for  the  analysis  of 
cascaded  systems.  The  time -frequency  duality  concept  is  discussed  with 
respect  to  the  system  functions,  and  the  introduction  of  physical  vari¬ 
ables  extends  the  duality  concept  so  that  knowing  one  relationship  is 
equivalent  to  knowing  four  relationships. 

The  expansion  of  system  functions  in  terms  of  a  complete  set  of 
functions  in  two  dimensional  space  or  in  a  sampling  series  for  an  ap¬ 
propriately  band-limited  and/or  time -lir  .ited  system  leads  to  a  matrix 
characterization  of  time -varying  linear  systems.  Schemes  for  evalu¬ 
ating  the  coefficients  of  the  expansions  are  described.  The  causality 
condition  requires  that  the  matrix  of  k{t,T)  be  lower  triangular. 
Marcovitz's  findings,  using  the  matrix  of  k(t,T)  ,  on  the  conditions 
for  the  existence  of  quasi -inver ses  and  inverses  to  time-varying 
systems  are  extended  to  the  recoverability  of  a  signal  of  finite  duration. 
The  matrix  formulation  is  applied  to  the  problem  of  finding  eigen¬ 
functions  and  eigenvalues  for  tim^ -varying  systems.  When  one  knows 
the  eigenvectors  of  a  time-varying  system,  the  input-output  relation¬ 
ship  is  "reatly  simplified. 
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When  the  h(t,v)  function  is  expanded  in  a  series  in  terms  of  a 
complete  set  of  realizable  networks  {4>.(v)}  ,  it  can  be  realized  by  a 
parallel  combination  of  h-separable  networks  in  which  a  typical  branch 
consists  of  the  network  followed  by  the  multiplier  a.(t)  .  Be¬ 

cause  of  the  difficulty  in  synthesizing  an  arbitrary  multiplier,  one  con¬ 
siders  the  double  expansion  of  h(t,  v)  in  terms  of  the  complete  set 
{4^  .(t)vi;^(v)}  wh  ere  one  has  some  choice  in  the  set  of  multipliers  {(j>^{t)}. 
In  particular,  if  the  multipliers  are  sisoids  the  multiplier  becomes  a 
standard  modulator  network.  A  unique  realization,  basea  on  the 
double  expansion,  is  presented  where  the  networks  {4^^(v)}  are  con¬ 
nected  to  the  multipliers  {4)^(t)}  by  a  resistive  coefficient  matrix.  A 
realization  scheme  using  the  link  structure  and  based  on  the  sampling 
theorem  is  also  presented. 

The  characterization  and  analysis  methods  are  shown  to  be 
applicable  to  characterizing  a  satellite  communication  system  and  to 
correcting  for  delay  and  Doppler  in  an  air-to-ground  communications 
system  and  in  a  side-looking  radar  surveillance  system.  The  matrix 
methods  are  applied  to  a  feedback  control  system  for  a  time -varying 
plant  and  to  finding  the  system  matrix  of  a  whiteniiig  filter  whose  out¬ 
put  is  white  stationary  noise  when  the  input  is  nonstationary  noise  with 
a  given  correlation  R  (t,r)  .  The  matched  filter  for  a  channel  with 
nonstationary  noise  is  shown  to  consist  of  the  whitening  filter  followed 
in  cascade  by  a  time-varying  matched  filter  that  is  matched  to  the 
signal  component  of  the  output  of  the  whitening  filter.  When  the  noise 
is  slowly  varying,  the  optimum  transmitted  signal  is  found. 
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I.  INTRODUCTION 


Linear  time -varying  systems  have  received  considerable  atten¬ 
tion  in  recent  years.  Besides  the  intellectual  challenge  of  the  extension 
of  system  theory  that  linear  time-varying  systems  present  to  the  the¬ 
orists,  there  is  an  increasing  practical  need  for  techniques  of  analyzing 
and  synthesizing  these  systems.  Description  and  analysis  of  physical 
systems  by  time-varying  models,  analysis  of  existing  time-varying 
systems,  more  effective  use  of  physical  devices  exhibiting  time- 
varying  characteristics,  and  adaptive  feedback  control  of  time-varying 
systems  are  some  examples  of  practical  as  well  as  theoretical  interest. 

Little  work  in  time-varying  systems  had  been  done  from  the 

1 

system  theory  point  of  view  before  1950  when  Zadeh  introduced  the 
H  system  function.  Since  then,  however,  a  number  of  articles  on  time- 
varying  system  theory  have  appeared  in  the  liaterature.  The  G  system 

function  that  is  the  dual  of  the  H-system  function  was  introduced  by 

2  3  4 

Gersho,  and  more  system  functions  have  been  introduced  by  others.  ’ 

In  this  connection,  time -frequency  duality  seems  to  play  an  important 
5 

role.  A  clear  description  of  all  the  various  system  functions  and  the 
transform,  functional,  and  dual  relationships  among  them  is  now  pos¬ 
sible. 

A.  THE  RELATIONSHIPS  AMONG  SYSTEM 

FUNCTIONS  OF  TIME- VARYING  SYSTEMS 

In  the  study  of  time-varying  systems,  various  system  functions 
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?  rise  that  are  useful  in  characterizing  the  system  and  in  determining 
the  output  from  a  given  input.  For  a  given  system,  one  system  function 
may  be  easier  to  find  or  work  with  than  another  system  function.  All 
the  system  functions  are  now  defined,  and  the  attempt  is  made  to  show 
clearly  the  relationships  which  exist  among  all  the  system  functions. 

This  information  will  be  useful  for  finding  dual  results,  and  for  finding 
one  system  function  when  another  system  function  is  given. 

In  Figure  1.  1,  the  relationships  among  the  system  functions  are 
shown  in  diagram  form.  Some  of  these  functions  are  familiar,  but 
others  that  are  new  are  explained  here. 

The  system  functions  in  the  time -time  domain  give  the  system 
output  in  time,  to  an  impulse  in  time  applied  at  the  input.  These  func¬ 
tions  are: 

k(t,T)  =  output  at  time  t  to  an  input  applied  at  time  r  , 
g(v,  t)  =  output  V  seconds  after  an  input  applied  at  time  r  , 
h(t,  r)  =  output  at  time  t  to  an  input  applied  r  seconds  ago. 

The  time-shift  or  "age"  va;riables  are 

v  =  r-  t-  T.  (If) 

The  impulse  -  response  functions  in  time  are  therefore  related  by  the 
changes  of  variables, 


g(v,  r) 

=  k(  T  +  V,  r) 

(1  2) 

hit,  r) 

=  k(t,t-r) 

(1.  3) 
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TIME  -  TIME  DOMAIN 
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Note  that  the  function  h(t,  r)  has  its  variables  interchanged  from  pre¬ 
vious  definitions,  later  leading  to  the  fact  that  corresponding  variables 
of  dual  functions  are  duals.  This  was  not  true  before,  unless  one  re¬ 
labeled  the  variables  of  either  the  function  or  its  dual. 

The  system  functions  in  the  frequency-frequency  domain  give 
the  system  output  in  frequency,  to  an  impulse  in  frequency  applied  at 
the  input.  These  functions  are: 

K(s,X.)  =  output  at  frequency  s  to  an  input  at  frequency  X.  , 

N(p,X.)  =  output  at  p  cycles  higher  than  the  input  frequency  \  , 
M(s,or)  =  output  at  frequency  s  to  an  input  at  cr  cycles  lower. 

The  frequency- shift  variables  are 

p  =  (7  =  s  -  \  .  (1. 

The  impulse  -  re  sponse  functions  in  frequency  are  therefore  related  by 
the  changes  of  variables, 

N(p,\)  =  K(p  +  \,\)  ,  (1. 

and 

M(s,<r)  =  K(5,  s  -  cr)  .  (1. 

The  frequency-impulse-response  functions  K,  N  and  M  are,  re¬ 
spectively,  the  double  Laplace  transforms  of  the  time -impulse - 
response  functions  k,  h  and  g  .  The  functions  k(t,  t)  and  K(s,\)  , 
h(t,  r)  and  M(s,(r),  and  g(v,  t)  and  N(p,\)  are  duals,  and  their 
corresponding  variables  are  dual  variables. 


The  fum  tions  in  the  time-frequency  and  frequency-time  domains 
are  of  a  mixed  nature  and  must  be  discussed  separately.  The  familiar 
system  functions  G(s,t)  and  H(t,  X)  are  defined  by  a  single  trans¬ 
form  of  g(v,  r)  and  h(t,r),  respectively.  These  system  functions  are 
convenient  because  they  look  like  system  functions  of  time -in variant 
systems.  This  is  evident  from  the  alternate  definitions  of  the  G(s,  t) 
and  f^t,  \)  system  functions 


The  functions  G(s,t)  and  H(t,\)  are  duals. 

The  functions  K^(s,r)  and  K^(l,\)  are  defined  as  single 
transforms  of  k(t,  t)  by 


and 


K^(s,  r) 


oo 

=  j  k(t,  r)  e"®^  dt 

-CD 


(1.9) 


K2(t,\) 


-I 


k(t,  r)  e^^  dr 


(1.  10) 
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and 


K.(tA)  =  H(t,X)  =  y(t)  .  (1.  12) 

x(t)  =  e 

[X(s)  =  2Tr6(s  -  \)] 


Now  a  physical  interpretation  can  be  given  to  K^(s,t)  and 
K^ltA)  ■  The  function  K^(s,t)  is  the  output  in  frequency  to  an  im¬ 
pulse  in  time  which  is  applied  at  time  t  =  t  ,  and  the  function  K^it.X) 
is  the  output  in  time  to  an  impulse  in  frequency  applied  at  frequency 
s  =  X  .  The  system  output  is  given  by 


(1.13) 


(1.  14) 


The  mixed-impulse-response  functions  K^(s,t)  and  K^(t,  \)  are  duals. 
One  convenience  of  the  interpretation  of  the  K  functions  as  impulse 
responses  is  that  one  has  to  remember  only  one  input-output  equation, 
instead  of  four: 

y(output  variable)  =  ^Y(output  variable,  input  variable) 

x(input  variable)  d(input  variable)  ,  (1.  15) 

where  y  is  the  K-system  function  which  is  appropriate  for  its 
variables . 
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The  complimentary  system  f\' actions  H'(p.t)  and  G'(v,(r) 


are  defined  according  to  Figure  1.  1  as 


and 


oo 


H'{p,r)  =  J'h(t,r)e  dt 

-oo 


■  pt 


oo 


G'(v,  a) 


=  / 


g(v,T)  dr 


-GO 


(1.16) 


(1.  17) 


No  physical  significance  for  the  complimentary  system  functions  has 
been  found  yet,  but  they  are  still  effective  in  characterizing  the  sys¬ 
tem  because  they  are  uniquely  related  to  the  other  system  functions. 
The  complimentary  system  functions  H'(p,r)  and  G'(v,tr)  are  duals, 
and  the  following  relationship  holds  between  them: 


H'(p,  r)  =  G'(r,  p)  e'^^ 


(1.  18) 


B.  DRIVING-POINT  IMMITTANCE  FUNCTIONS 
OF  LINEAR  TIME-VARYING  SYSTEMS 

The  G  ,  H  and  K  system  functions  give  relationships 
between  input  and  output  variables  of  a  system,  without  regard  to  the 
physical  quantities  that  the  variables  represent.  The  input  and  output 
variables  in  the  driving-point  case  represent  voltage  and  current,  and 
the  G  ,  H  and  K  system  functions  take  on  an  impedance  or  admit¬ 
tance  character.  The  driving-point  immittance  functions  are  defined  by 
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r 


from  the  above  definitions  and  from  previously  obtained  equations 
relating  input  and  output  variables.  They  are 


i{t)  =  E(\)  e^^  dk  =  E(k)  dk  =  eir)  dj 

e(t)  =  jH^(t,k)I(k)  dk  =  jK^^ft.k)  I(X)  dX  =  i(T)  dr 

I(s)  =  Jcyis,  t)  e(T)  e“®’^dr=  Jk^^(s,  t)  e(T)  dr  =jK^(s,k)  E(X)  dX 
E(s)  =  Jc^(s,t)  \(t)  dr  =  Jk^^(s,  r)  1(7)  dr  =  jK^(s,k)  I(X)  dX 


(1.25) 


(1.26) 


(1.  27) 


(1.28) 


C.  TRANSFER  IMMITTANCE  FUNCTIONS 

Transfer  immittance  functions  of  time-varying  linear  systems 
can  be  defined  by  direct  analogy  to  time-invarient  systems.  For 
example,  in  time-invarient  systems  the  transfer  impedance  Z.,  (s) 
is  defined  by 


E.(s) 

Z,^(s)  •=  -J— 


ys) 


(1.29) 


L(s)  =  0  .  j  91!  k 


By  direct  analogy  the  following  can  be  defined: 
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D.  DUALITY  CONCEPTS 

The  introduction  of  the  physical  variables,  current  and  vol¬ 
tage,  has  added  a  new  dimension  to  duality.  First,  one  can  consider 
duality  on  the  basis  of  dual-system  functions.  It  was  seen  before  that 
G(s,t)  ,  H{t,X)  ;  K^(s,t)  ,  K2(t,\)  etc.  are  dual-system  functions, 
and  their  corresponding  arguments  are  dual  arguments.  Adding  a 
subscript  of  Z  or  Y  on  the  system  function  does  not  affect  this  type 
of  duality,  hence  G^(s,t)  ,  HY(t,X)  ;  »  K^yit,  X)  etc.  are 
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duals.  To  take  a  dual  on  the  basis  of  dual-system  functions,  one  re¬ 
places  all  system  functions  by  their  dinls  and  uses  dual  arguments. 
Equations  (1.25)  and  (1.27),  and  Equations  (1.26)  and  (1.28)  are  duals 
on  this  basis . 


Secondly,  one  can  consider  duality  on  the  basis  of  dual  physical 
quantities  such  as  v  and  i  ,  Z  and  Yetc.  Using  the  same  system 
function  does  not  affect  duality  on  this  basis,  hence  G2(s,  t),  Gy(s,  t), 
H^ltik),  Hylt.  h)  etc.  are  duals.  To  take  a  ou?l  on  the  basis  of  dual¬ 
physical  quantities,  one  replaces  all  physical  quantities  by  their 
duals.  On  this  basis,  Equations  (1.  25)  and  (1.  26)  and  Equations  (1.  27) 
and  (1.  28)  are  duals. 

Finally  one  can  consider  "complete"  duality,  that  is  duality  on 
the  basis  of  both  physical  quantities  and  system  functions.  To  take  a 
"complete"  dual,  one  replaces  physical  quantities  by  their  duals, 
system  functions  by  their  dual-system  functions,  and  all  arguments 
by  their  dual  arguments.  On  this  basis,  Equations  (1.  25)  and  (1.  28) 
and  Equations  (1.  26)  and  (1.  27)  are  duals. 

As  a  consequence  of  this  extended  duality,  knowing  one  rela¬ 
tionship  is  equivalent  to  knowing  four  relationships  instead  of  two. 

For  example,  given  Equation  (1.25),  one  can  take  its  dual  on  the  basis 
of  dual-system  function  to  obtain  Equation  (1.  27);  one  can  take  its  dual 
on  the  basis  of  physical  quantities  to  obtain  Equation  (1.  26);  and  one 
can  take  its  "complete"  dual  to  obtain  Equation  (1.  28). 

This  concept  of  system-function  duality  has  a  physical  signifi- 
cance.  ..’or  example,  a  time -invariant  system  and  a  time  multiplier 
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are  duals,  and  a  time -varying  delay  system  is  the  dual  of  a  tielective 
frequency- shift  system. 
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II.  CASCADED  SYSTEMS 


A.  SYSTEM  FUNCTIONS  FOR 
CASCADED  SYSTEMS 

The  impulse-response  function  k(t,T)  is  useful  in  finding  the 
over-all  system  function  for  a  cascade  of  time-varying  systems  when 
the  individual  system  functions  are  known.  For  two  systems  in  cas¬ 
cade,  as  shown  in  Figure  2.1,  the  over-all  system  function  k(t,r) 
can  be  found  easily.  When  the  input  is  an  impulse  in  time  applied  at 
time  t  =  T  ,  the  output  of  the  first  network  in  time  is 

y{t)  =  k<^^  (t.T)  ,  (2.  1) 

where  k^^^(t,T)  is  the  impulse  response  of  the  first  network.  Applying 
the  input-output  relation  of  Equation  (1.  15)  to  the  second  system  with 
y(t)  as  its  input  yields  the  over-all  impulse- re sponse  function; 

CO 

k(t,T)  =  J  k^^ht^,T)  dt^  .  (2.2) 

-oo 

Equation  (2,  2)  is  the  convolution  product  for  time-varying  systems. 

In  a  similar  manner  the  over-all  mixed  impulse  response  is  found 
to  be 

oo 

K^(s,t)  =  J  K^^^^s.t^)  k^^^{t^,T)  dt^  .  (2.3) 

-oo 
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FIGURE  2.  1.  Two  Time-Varying  Systems  in  Cascade. 

Equations  for  the  other  K-systeni  functions  are  obtained  by  taking  the 
duals  of  Equations  (2.  2)  and  (2.  3): 


K(s,X)  =  —  Jk^^^s.p^)  dp^ 


2Trj 


n 


^  'K'/^(t,p^)  dp^ 


(2.4) 


2TTj 


These  results  are  easily  extended  to  a  system  of  n  networks  in  cas¬ 
cade.  The  over-all  k(t,T)  function  is 


k{t,T)  =  f.  .  '^n-2^  '  '  ’ 


.(2) 


.(1) 


k'‘''(t^,  t^)  k'^Mt^.r)  dt^.  .  .  dt 


n-1 


(2.5) 


the  over-all  K^(s,t)  function  is 

K^(s,t)  =[■■■[  ^^*^n-l’  ’^n-2^ 


k^^^t^.  t^)  k^^^t^.r)  dt^.  .  .  dt^_^ 


(2.6) 
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The  other  K  system  functions  can  be  expressed  as  the  duals  of  Equa¬ 
tions  (2.5)  and  (2.6).  Equation  (2.5)  is  not  the  only  expression  for  the 
over-all  k(t,  r)  function  because  the  convolution  may  be  done  over  any 
mixed  basis.  A  more  general  expression  for  k(t,T)  is 


k(t,T)  = 

^2Trj 


n  - 1 

.  \m . - - — , 

/■/ 


/it, 


(n-l) 


^^^n-1’  ^n-2 


)  .. 


(2.  7) 


.(j); 


where  is  either  a  time  or  a  frequency  variable,  and  K'‘^^(Pj,  , 

and  P 

to  their  arguments. 


K^^^(t,  p^  ^)  and  K^^^(P^,t)  are  the  K-system  functions  appropriate 


B.  THE  TERMINATED  MULTIPLIER 

An  important  cascaded  system  is  the  terminated  multiplier. 
Because  of  parasitic  elements  at  high  frequencies,  it  becomes  neces¬ 
sary  to  consider  multipliers  along  with  their  associated  input  and 
output  networks.  The  link  structure  can  be  regarded  as  a  parallel 
connection  of  terminated  multipliers;  therefore,  the  analyses  pre¬ 
sented  here  are  applicable  to  studying  the  link  structure  as  a  high- 
frequency  modulator.  In  modulating  systems  it  is  important  to  de¬ 
termine  when  the  system  functions  are  separable  into  a  function  of  the 
time  variable  multiplied  by  a  function  of  the  frequency  variable  be¬ 
cause  it  is  easy  to  relate  the  input  to  its  modulated  signal  when  the 
system  function  is  separable. 
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The  systems  of  Figure  ?..  2  and  Figure  2.  3  are  G-separable 
ai  d  H-separable,  respectively,  \/ith 

G(s,t)  =  a{T)  B(s)  (2.  8) 

for  the  first  system,  and 

H(t,M  =  a(t)  B(X)  (2.9) 

for  the  second  system.  The  terminated  multiplier  is  shown  in  Figure 
2.4.  The  over-all  system  function  K^(s,t)  is  found  by  considering  the 


FIGURE  2,2.  G-Separable  System. 


FIGURE  2.  3.  H-St‘parable  System. 

terminated  rnuliiplier  as  the  network  B(s)  in  cascade  with  the  G- 
separable  network  consisting  of  the  multiplier  a(t)  followed  by  the 
network  C(s)  .  U.sing  Equation  (2.3)  with 

k^^^t,T)  -  b{t-T)  ,  (^.  10) 
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FIGURE  2.4.  Multiplier  with  Its  Asso¬ 
ciated  Input  and  Output  Networks. 


and 


yields 


Making  the  change  of  variables 


r  =  t  -  T 

gives 


(2.13) 


The  over-all  K^it.X)  function  can  be  found  by  considering 
the  terminated  multiplier  as  an  H-separable  network  followed  by  a 
network  C(s)  with 
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K'  '(s,X)  =  B(X)  A(s-X) 


(2.15) 


K^2^^t,X)  =  C(X) 


(2.16) 


From  Equations  (2.  4)  ,  (2.15),  and  (2.16), 


K2(t,X)  =  Ja(s-X)  C(s)  ds  ; 


(2.  17) 


making  the  change  of  variables, 


p  =  s  -  X 


(2.  18) 


yields 


H(t,X)  =  A(p)  C(p+X)  dp 


(2.  19) 


It  appears  to  be  difficult  to  find  the  general  conditions  under  which 
the  system  functions  of  Equations  (2.14)  and  (2.  19)  are  separable.  If, 
however,  one  assumes  the  multiplier  to  be  of  exponential  form: 


a(t)  =  e 


A(s)  = 


s  -  p^ 


G(s,t)  =  B(s  -  p^)  C(s)  e 


(2.  20) 


=  B(s  -  p^)  C(s)  a(T) 


[2.  21) 


H(t,X)  =  B(X)C{X  +  p^)e 


=  B(X)  C(X  +  p^)  a(t) 


(2.  22) 
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From  Equation  (2.  22),  Equation  (1.  12)  and  Equation  (1.  14)  one  sees 

that  the  output  of  the  terminated  multiplier  for  x(t)  as  the  input  is  the 

P  t 
^  o 

signal  y(t)  modulated  by  a(t)  =  e  ,  where 

y{t)  =  —  /b(M  C(\  +  p  )  X(K)  e’"^  d\  .  (2.23) 

Thus,  for  a  separable  terminated  multiplier  structure  the  input  is 
reshaped  according  to  Equation  (2.  23)  and  then  is  modulated  by  the 
multiplier  a(t)  . 


C.  PERIODIC  MULTIPLIERS 

Now  one  can  easily  extend  these  results  to  the  class  of  periodic 
multipliers  a(t)  ,  which  is  indeed  an  important  class  of  multipliers 
for  the  general  case  of  modulation.  If  a(t)  is  periodic  with  period  T, 
it  can  be  expressed  in  a  Fourier  series. 


where 


(2.  24) 


(2.  25) 


/ 

Now,  from  Equations  (2.  21)  and  (2.  22),  the  system  functions  become 
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H(tA) 


(2.27) 


B(K)  C(K  +  p.) 


By  considering  certain  particu’a.  functions  B(s)  and  C(s)  , 
one  can  make  some  interesting  observations  from  Equations  (2.  26) 
and  (2.27).  If,  for  example,  C(X)  is  periodic  along  all  vertical  axes 
with  period  T  ,  then 


C(\  +  p.)  =  C(\) 

therefore 


(2.  28) 


H(t,X) 


B(M  C(X) 


=  B<\)  C(\)  a(t) 


(2.29) 


Similarly  if  B(s)  is  periodic  along  all  vertical  axes  with  period  T  , 

B(\  -  p.)  =  B(X)  ,  (2.  "0) 

and 

G(s,r)  =  B(s)  C(s)  a(T)  .  (2.  31) 

The  H  function  of  Equation  (2.  29)  and  the  G  function  of  Equation 
(2.31)  are  completely  separable. 

One  can  also  regard  Equations  (2.  29)  and  (2.  31)  in  terms  of 
sampling.  If,  for  example,  B{X)  has  a  spectrum  B(j(a)  along  the 
joj-axis  with  magnitude  and  phase  shown  in  Figure  2.5,  with  C(jw) 
having  the  magnitude  and  phase  shown  in  Figure  2.  6,  and  a(t)  a 
periodic  time  function  such  that 

=  T  .  (2.32) 
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(2.  33) 


"  1.  =3,  a^  =  -2.  a^=|.  :  4.  - 1 ,  a^^  =  a_j^  , 

then  H(t,  X)  has  the  magnitude  curve  shown  in  Figure  Z.  7. 

Note  that  |H(t,X)  |  is  independent  of  time.  The  phase  of 
H(t,  X)  does,  however,  vary  a.s  a  function  of  time.  At  t  =  0  ,  the 
phase  is  given  in  Figure  2.8,  and  at  time  t  ,  one  must  add  nTt/Zir 
degrees  to  the  piece  centered  about  nw^/S  . 

One  can  give  a  geometric  interpretation  to  the  phase  of  H(ja),  t)  ; 
i.  e.  ,  each  piece  in  the  curve  of  Figure  2.  8  is  traced  on  the  surface  of 
a  cylinder  of  unit  radius  centered  about  the  u;  axis,  and  a  cut  is  made 
between  each  nonzero  piece  in  Figure  2.8.  Thus  the  original  cylinder 
is  divided  into  a  number  of  sections.  Now  the  cylindrical  section  that 
contains  nw^/S  rotates  v.ith  angular  frequency  nw^/5  radians  per 
second,  and  the  phase  angle  at  u>  =  is  measured  in  a  plane  parallel 
to  the  x-y  plr ne  at  w  =  .  The  phase  of  H(t,ju))  ,  viewed  in  this 

way,  is  shown  in  Figure  2.  9. 

Now  it  i.s  ea,*^  to  see  what  would  happen  for  other  spectra  and 
values  of  T  .  U  xn  xtie  above  example,  T  >  ,  then  H(t,jw)  would 

have  only  one  sample,  with  magnitude  and  phase  shown  in  Figure  2.10. 
Note  that  H(t,jw)  is  not  a  function  of  t  i.n  this  case. 

D.  LINK  STRUCTURE 

The  methods  fi^r  finding  the  system  function  of  a  multiplier  with 
its  associated  input  and  output  networks  can  be  used  to  analyze  the  link 
structure.  The  link  ciructure  can  be  thought  of  as  having  the  form 
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shown  in  Figure  2.  1 1 .  If  the  a(t)  's  are  pe r  iodic  multiplie r  s  ,  i .  e  .  , 


(2.  34) 


then 


H(t,M 


■ZI-. 


ik  ^k**'  *  Pik> ' 


k  i 


■I 


Sk<^)  7  ^ik  ^k<^  ^  Pik>  ^ 


(2.35) 


■I 


G(s.t)  =  ;  Cj^(s)  >  a.j^  -  p.^)  e 


(2.36) 


E.  ALTERNATING  STRUCTURE  WITH 
EXPONENTIAL  MULTIPLIERS 


The  system  functions  associated  with  the  series  alternating 
structure  of  Figure  2.12  when  the  multipliers  are  exponential, 


Pit 

a.(t)  3  e 


(2.37) 


have  the  separable  forms; 


H(t,\)  =  B^(\)  B2(\ +p^).  .  .  B^(\+Pj  +  .  .  .  -I  p^_^)  a^(t).  .  .  aj^_i(t) 


(2.  38) 
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I  ' 


C,(s) 
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B,(s) 


c 
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Mo 

B,(s)^ 


v.y  /  -  \ 

A  I  VS/ 
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vy  /  \\ 
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FlGllRF  2  12.  Series  Alternating  Structure. 


G(s,t)  =  B^(s-p^-p^-.  .  .  B^_j{s-p^)  B^(s)  a^(T)  ■••  ■ 

(2.  39) 

Now  consider  the  particular  example  of  the  H(t,X.)  system 
function  for  a  band  -  ’imited  input  X(V)  , 


X{K)  ^0  for  I X I  >  .  (2.  40) 


Define  a  restriction  of  the  networks  to  a  band-limited  form  by 


B^(M 


oth(  rwise 


(2.41) 


Tfien  the  quantity  of  interest  for  determining  the  reshaped  output  time 
funi  tion  x(\)H(t,\)  becomes 


X  Xi  H(t,X)  =  X(X)[B^(X)  IX^J  [B^(X)|X^j..  .  [B^(X) 'X^]  e 


(p^+.  .  .  +Pj^_^)  t 


(2.  42) 


Now  one  c  an  note  that  if 


r 


1  for 


>  -(p^+-  -  • 
lx  <  IX^-pj-. 


■  '^k-l 


0  otherwise 


V 


then 


X(X)  H(t.X)  -  X(X)  e 


(Pi  ^  •  ■♦Pk  _ 


(2.  43) 


(2.  44) 
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and  x(t)  is  not  reshaped  at  all.  This  means  that  if 

cycles  above  and  below  -  (p^ +.  .  .  .  then  multiplication  of  the 

input  signal  x(t)  will  resuli. 

If  one  now  considers  the  multipliers  in  the  alternating  struc¬ 
ture  as  periodic  functions  of  time,  namely 


a.(t) 


(2.45) 


then  by  superposition,  one  immediately  obtains 


12  n-1 


H(t,M  = 


z 


Ik 


•••  ^n-1,  J- • 


(2.46) 


and 


n.  n,.  .  .  n  , 
12  n-1 


G{s,t)  = 


k  .  ,  .  k  .  =1 
n  n-1 


B  (M  e 
n 


’l,kj+---  %-!,  k^_j)  ’■ 


(^.47) 


F.  MODULATOR -DEMODULATOR  STRUCTURE 


Note  that  the  alternating  structure,  which  consists  o-  two 
multipliers  and  three  networks,  may  be  regarded  as  a  model  for  a 
modulator-demodulator  system,  where  the  middle  network  embodies 
the  system  response  of  the  terminating  network  of  the  modulating 
multiplier,  the  channel,  and  the  system  response  of  the  input  network 
of  the  demodulating  multiplier. 

The  system  responses  for  the  modulator-demodulator  structure 
with  multipliers 

Pit  P^t 

ai(t)  =  e  and  ~  ^  (2.48) 

are: 

(Pl  +??)  t 

H(t,X)  =  Bi(M  B2(X  +  Pi)  B3(X  +  Pi +P2)  e  ,  (2.49) 

(Pl  +  P?)^ 

G(s,r)  =  Bi(s  -  Pl  -  P3)  B^ls  -  Pi)  B3(s)  e  .  (2.50) 

For  Pl  =  -p^  ,  and  the  input  limited  to  the  band  <  X  < 

and  the  conditions: 

Bi(X)  and  B3(X)  flat  for  X^  cycles  above  and  below 
0  cycles,  and 

B^(X)  flat  for  X^  cycles  above  and  below  cycles,  then 

X(X)H(t,X)  =  X(X)  ,  (2.51) 


and  the  input  to  the  second  multiplier  is 


Pit 

X(>.)  e 

Thus,  the  input  signal  has  been  modulated  and  demodulated  success  - 
fully. 

For  the  case  of  multipliers  that  are  real  sinusoids,  i,  e.  , 


(2.  52) 

(Pl  +  P2)  t 

H(t.  M  =  B^(\)  +  Pl)  +  Pl  +  p^)  e 

(Pl  -  P2)t 

+  Bi(X)  B2(\  +  Pl)  B3(\  +  Pl  -  P2)  e 

(P2  -  Pi)  ^ 

+  Bi(\)  -  Pl)  BjiX  +  P2  -  Pl)  e 

-(Pl  +  P2)t 

+  Bi(\)  B^iX  -  Pl)  B3(\  -  Pl  -  p^)  e  ^  .  (2.53) 

If  Pl  =  p^  and  the  networks  satisfy  the  conditioas  in  the  previous  ex¬ 
ample,  then 

X(X)  H(t,X)  =  2  X(X)  .  (2.54) 


Pit  p^t 


a^l(t)  =  e  +  e 


Pz*  "^2^ 

a2(t)  =  e  +  e 


one  obtains,  by  using  Equation  (2.  38), 


and  the  input  to  the  second  multiplier  is 


Thus,  the  input  signal  has  been  modulated  and  demodulated  successfully. 
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III.  REPRESENTATION  OF  SYSTEM  FUNCTIONS 
BY  SAMPLING  AND  SERIES  EXPANSIONS 


A.  INTRODUCTION 


The  expansion  of  a  function  of  several  variables  in  a  series. 


f(x^,  x^, 


■*N> 


■I 

i=  1 


•  ’  ^N^ 


(3. 


that  is  convergent  uniformly  or  in  the  mean  is  useful  for  theoretical 
calculations  as  well  as  in  practical  applications  where  one  can  store 
a  close  approximation  to  a  continuous  function  by  storing  a  finite  num¬ 
ber  of  expansion  coefficients. 

When  the  expansion  coefficients  are  samples  of  the  function, 
the  expansion  is  a  sampling  series  and  the  functions  g^(x)  can  be 
considered  as  interpolation  functions.  The  extension  of  the  sampling 
theorem  in  one  dimension  to  N  Euclidean  dimensions  by  Petersen 
and  Middleton^  is  reviewed  in  Appendix  A.  Applications  to  expan¬ 
sions  of  system  functions  will  be  detailed  in  this  chapter. 

Given  that  the  sets 


k^7i=1.2,  3,  ...  '  . ^ 


are  complete  sets  on  the  intervals  (a.,b.),  respectively,  Chen 

7 

f(x^,  x^,  .  .  .  ,  Xj^)  can  be  expanded  in  a  mean-square  convergent 
series  in  terms  of  the  set 
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’'z . 


i-  1,  2,  . 


^1’  ^2’  ■  •  •  ‘ 


(3.  2) 


For  N  =  2  the  system  functions  can  be  expanded  in  a  double  series, 
and  if  the  sets 

i-1.2 _ 

are  orthonormal  for  j  -  1,  2,  the  expansion  coefficients  can  be 

evaluated  by  a  network  that  is  quite  similar  to  the  network  used  to 
evaluate  the  samples  for  the  two  dimensional  sampling  series.  If 
the  system  function  h(t,  v)  is  expanded  in  terms  of  the  set 


\  ^  J  I 


i,  2, 


> 


whert:  4^j(0  is  realizable  as  the  impulse  response  of  a  passive  netwo 'k, 
then  the  truncated  expansion  of  h(t,  v)  has  a  realization  as  a  parallel 
combination  of  H-separable  networks. 


B.  SAMPLING  EXPANSIONS 

The  one  dimensional  sampling  theorem  in  time  states  that  for 
a  function  f(t),  whose  Fourier  transform  F(u))  is  zero  outside  the 
band  joj|  5  2nB  ,  one  can  specify  sampling  times  and  an  interpolation 
function  g(t)  such  that 
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(3.  3) 

k/2B)  ,  g(t)  is 

(3.4) 

The  one  dimensional  sampling  theorem  in  frequency  states  that  a 
function  F(!jj),  whose  inverse  transform  f(t)  is  time-limited,  can  be 
expanded  in  a  sampling  series. 

The  proof  of  the  sampling  theorem  in  N  dimensions  is  reviewed 
in  Appendix  A  .  In  particular,  the  two  dimensional  case  is  of  interest 
for  system  functions.  The  theorem  in  two  dimensions  states  that  for  a 
function  y(s,  r)  (where  s  or  r  may  be  either  time  or  frequency  vari¬ 
ables),  whose  double  Fourier  transform  ylu,  v)  is  zero  outside  a 

finite  region  of  the  (u,  v)  plane,  one  can  find  sampling  times  s  and 

k 

rj^  and  an  interpolation  function  g(s,  r)  such  that 

oo 

V(s,r)  =  ^  g(s-s„.r-rj  .  (3.5) 

n,  m=-oo 

The  sampling  times  and  interpolation  function  have  a  degree  of  arbitrari¬ 
ness  depending  on  the  region  in  the  (u,  v)  plane,  outside  of  which  y 
is  zero.  For  the  simplest  case  the  region  is  a  rectangle:  R=(-s^,  s^)'x 
(-r^,  r^),  and  the  interpolation  function  g(s,  r)  is  a  product  of  cardinal 


interpolation  functions: 


g(s,r)  = 


sin  s  s  sin  r  r 
o  o 


(3.6) 


Thus,  the  system  function  k(t,  t),  whose  double  Fourier  trans¬ 
form  K(w,  ?,)  is  zero  outside  the  rectangle  R  in  the  (w,  C)  plane, 
where 


R  =  ZttB)  X  (-2itW,  2ttW) 


(3.7) 


can  be  expanded  in  the  series 


k(t,  t) 


oo 

n,  m=  -oo 


sin  2TrB 


(^~  A)  sin  2ttW 


(3.8) 


where  because  of  causality 


^  (iW  -  w)  =  ° 


m  n 

:w  2B 


(3.9) 


The  system  function  K|^(a>,  t)  whose  double  Fourier  transform 
^^(t,  ?,)  is  zero  outside  the  rectangle  in  the  (t,  ^)  plane. 


R  =  (-T^,  T^)  X  (-27rB,  2ttB) 


(3. 10) 


can  be  expanded  in  the  sampling  series 


K^(w,  t)  = 


oo 


sin  T^  (o-  •  ,  t,  /  k  ' 


j,  k=-oo 


(^-2b) 


(3.  11) 


The  system  functions  ^^(t,  C)  or  K{co,  C)  can  be  expanded  by 
the  sampling  theorem  if  their  double  transforms  K^(u>,  r)  or  k(t,  t) 
vanish  outside  of  a  finite  portion  of  the  {u,  t)  or  (t,  t)  planes,  respec¬ 
tively.  The  four  possible  expansions,  depending  on  whether  the  system 
is  time-limited  in  both  variables,  frequency-limited  in  both  variables, 

or  time-limited  in  one  variable  and  frequency-limited  in  the  other,  are 

5 

to  be  expected  by  time-frequency  duality. 

To  instrument  the  expansion  of  k(t,  t)  by  the  sampling  series 
given  in  Equation  (3.8),  one  must  take  an  infinite  number  of  samples. 
Since  this  may  be  infeasible  from  a  practical  point  of  view,  one  could 
take  a  finite,  but  large  enough  number  of  samples  inside  a  certain 
finite,  but  possibly  large  region  of  the  (t,  t)  plane  with  the  samples 
outside  this  region  small  enough  so  that  the  truncated  sum  differs 
from  k(t,  t)  by  an  acceptable  amount  of  error.  For  simplicity,  take 
the  region  to  be  the  square  S  =  ("^o*  *  ^”^o'  pl«ine. 

To  evaluate  the  sample  values 

,  /  n  rn  \  r  _  F  ^b1  [ 

^  \^‘  Twj  "  p  2wJ  ’  ^  1  >  •  •  •  •  L^^^oJ 

(where  the  symbol  [a]  meaii.s  the  largest  integer  contained  in  the 
number  a),  one  applies  an  impulse  to  the  system  at  time  xn/P.W  and 
then  samples  the  output  at  the  times  n/2B  ,  for  n  >  [m2B/2W]  ,  by 
multiplying  the  output  by  impulses  at  the  times  n/2B  and  then  inte¬ 
grating.  The  instrumentation  of  this  scheme  is  shown  in  Figure  3.  1. 
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In  order  to  evaluate  all  the  sample  values  in  the  square  S  ,  one 
must  let  m  vary  over  the  range  [  2WT^]  ,  -[  2WT^]  +  2WT^]j 

To  do  this  there  must  be  either  [4WT^j  identical  systems  with 
6(t-m/2W)  applied  to  the  system  whose  output  is  sampled  as 

in  Figure  3.  1,  or  the  time  variation  must  be  controlled  by  some  vari¬ 
able  elements  that  can  be  ''reset"  to  zerq  preparing  the  system  to 
evaluate  the  next  set  of  coefficients. 

Implementation  of  the  expansion  of  K^(oj,  t)  can  be  done  in  a 
maraer  that  is  easy  to  instrument.  Evaluation  of  the  sample  value 
K^(Trn/T^,  m/2B)  for  m  =  -M  ,  -M  +  1,  .  .  .  ,  M  is  done  by  applying  an 
impulse  in  frequency  6(aj-irn/T^)  to  the  network  and  then  sampling 
the  output  in  time  at  the  times  m/2B  .  Thus,  one  applies  a  complex 
sinusoid  of  frequency  7rn/T^  and  samples  the  output  in  time.  This 
technique  is  especially  useful  in  measuring  channels  such  as  the 
atmosphere.  The  evaluation  process  must  be  repeated  for  each  n 
to  obtain  all  the  samples. 


C.  EXPANSION  OF  THE  SYSTEM 

FUNCTIONS  IN  A  DOUBLE  SERIES 


1.  Time  -  Invariant  Systems 

For  time -invariant  systems,  the  impulse  response  function 
h(t)  can  be  expanded  over  the  interval  (a,  b)  in  the  series 


oo 


h(t) 


a.  4>.(t.) 


(3. 


1  1 


12) 
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where 


is  a  complete  orthonormal  set  over  the  interval  (a,  b)  ,  and  where  the 
coefficient  a.  is  given  by 


a. 

1 


b 


a 


h{t)  (|>.(t)  dt 


(3.  13) 


For  (a,  b)  =  (0,oo),  if  <|)^(t)  can  be  realizeci  as  the  impulse  response 
of  a  network,  then  a^  can  be  evaluated  according  to  the  following 

g 

scheme,  suggested  by  Huggins:  The  signal  h(-t)  is  applied  to  the 
input  of  each  of  the  networks  with  impulse  response  4)^(t),  and  the 
output  sampled  at  time  zero  is  the  desired  coefficient.  The  system 
shown  in  Figure  3.  2  is  used  to  implement  this  scheme. 


FIGURE  3.2.  Coefficient  Evaluation  Scheme  for  Single  Series. 
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Practical  restrictions  may  allow  one  to  reverse  only  T  seconds 


of  h(t)  ,  in  which  case  the  coefficients  obtained  by  the  scheme  of  Fig¬ 
ure  3.  2  are 

T 

y^(0)  =  j  h(t)  dt  .  (3.14) 

0 

These  y^(0)  are  an  approximation  to  a^  ,  if  h(t)  does  not  vanish  for 
t  >  T  .  This  same  approximation  to  a^  may  also  be  obtained  by  applying 
h(t)  to  the  network  with  impulse  response  t)>^(T-l)  u(t)  and  then  sampling 
the  output  at  time  T  .  Another  way  to  evaluate  the  coefficient  is 
to  sample  the  output  of  the  given  network  h(t)  at  time  zero  when  the 
input  is  4>^{-t).  This  process  must  be  repeated  for  each  i,  unless 
there  are  as  many  identical  networks  as  coefficients  to  evaluate. 


Z.  Time-Varying  Systems 
Consider  the  sets  of  orthonormal  functions 


and 


1.  2. 


which  are  complete  on  the  intervals  (a,  b)  and  (c,  d),  respectively. 
Their  Cartesian  product  set 


is  complete  on  the  rectangle  R  (a,b)  x  (c.d).  If  the  set 


1  s 


complete  on  (c,  d)  a.s  well  as  on  (a,  b)  ,  then  the  s«  '  ^-(x)  tj?  ( y)|  is 


complete  on  R  .  The  system  function  k(t,  t)  can  be  expanded  in  a 
double  series  that  is  valid  over  R: 


k(t,  t) 


CO 

I, 

n,  m=  1 


a  6  (t)  4'^{r) 
nm  n  m 


where  is  given  by 


nm 


// 


4>„(0  k(t,  t)  \\t  ^(t)  dt  dr 


(t.  t)  eR 

t  >T 


(3.  15) 


(3.  16) 


Equation  (3.  16)  is  valid  for  all  (t,  t)  if  k(t,  t)  vanishes  outside 
of  R  or  if  R  IS  the  entire  (t,  t)  plane.  The  coefficient  a  can 
be  evaluated  by  means  ot  a  network  with  the  input  4'^(t)  and  where 
the  integration  is  performed  over  the  limits  (a,  b),  as  shown  in  Fig¬ 
ure  3.  ja.  It  is  easily  seen  that  the  output  of  this  network  is  indeed 

a  and  the  set  of  coefficients 
nm 


n  -  1,  2 . N 


can  be  evaluated  simultaneously  by  the  network  shown  in  Figure  3.4. 

As  in  *lie  instrumentation  of  the  two  dimensional  sampling  theorem, 
to  let  m  vary  from  1  to  M,  one  must  either  have  M  identical 
networks  or  be  able  to  "reset''  the  network.  Note  the  Tmilarity 
between  the  coefficient  evaluation  scheme  of  Figure  3.4  and  the  sample 
evaluation  network  ot  Figure  3.  1.  They  are  exactly  the  samt  when 


k(t)\ 

A  (t)l 

<6(t-iT)\ 

(3 

\ '  / 

\  ‘  / 

\  / 
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FIGURE  3.4.  Coefficient  Evaluation  Scheme  for  Double  Series. 


The  sets  in  Equation  (3.  17)  are  not  complete  in  L  ,  but  the  sets 


sin  ZttB  t 


i 


^  ttB  j  t 


(3.  18) 


are  complete  on  (-ixi.oo)  for  functions  which  arc  appropriately  frequency- 
limited.  The  coefficients  obtained  by  usin^  the  sets  of  Equation  (3.  18) 
in  the  scheme  of  Figure  3.  4  are  the  same  as  those  obtained  by  using 
the  sets  of  Equation  (3.  17)  in  the  scheme  of  Figure  3.4. 

Since  the  system  k(t,  t)  is  causal,  the  truncated  expansion  of 
Equation  (3.  15)  can  be  improved  by  restricting  it  to  be  ztro  for  t  t; 


-4^- 


k(t,  T)^  < 


f  N,  M 

z, 

n,  m-  1 


a  4)  (t)  4^  (t)  for  (t,  t)  tR  and  t  >  t 

nm  m  '  \ 


(3.  19) 


0 


for  t  <  T 


Where  ^^{u))  and  $  ^(oj)  are  defined  by  the  Fourier  transforms 


oo 


/ 


(t)  e'j^^  dt 


-c» 


CD 

$-(w)  =  /  '^i 

-CD 


(t)  e  dt 


(3. 20) 


the  sets  and  are  orthonormal  and  complete  over  the 

intervals  (a',b')  and  (c',d')  that  are  appropriate  for  the  intervals 
(a,  b)  and  (c,  d)  ,  respectively. 

K(oj,  4),  the  dual  system  function  to  k(t,T  ),  can  be  expanded 
on  the  interval  R'  =  (a',b')  x  (c',d')  in  terms  of  the  complete  orthonormal 
set  $.(C)|: 


go 

K(cx.,  C.)  -  >  b  *  (w)  J  (C) 

'  nm  n'  “m 


n'riTl=  1 


(3.  21) 


where 


nm 


//  ‘n<“ 


)  K(w,  i)  dw  d; 


(3.  2Z) 


(w,;)  eR' 
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Jf  K(uj,  4)  is  zero  outside  of  R'  ,  or  if  R'  iS  the  entire  (w,  4)  plane, 
then  Equation  (3.  Zl)is  valid  on  the  entire  (u),  4)  plane.  The  coefficient 

can  be  evaluated  by  the  system  shown  in  Figure  3.  3b.  The  systems 
of  Figures  3.  3a  and  3.  3b  are  duals,  as  one  would  expect  from  time- 
frequency  duality. 

The  system  function  K^(cl),.t)  can  be  expanded  in  terms  of  the 
complete  orthonormal  set  oti  the  rectangle  R^-(a',b')x 

(c,d)  by 


QO 


K^(u,  r) 


c  $  (oj)  4>  (t) 

nm  n  m 


(3.2  3) 


n,  m-  1 


where 


nm 


//  $^(oj)  K^(a..r)  + 

(ca,T  )  eR^ 


m 


(t)  du  dT 


(3.24) 


Similarly  K2(t,  4)  can  be  expanded  in  terms  of  the  set  (t) 

which  is  complete  and  orthonormal  on  R^  =  (a,  b)  x  (c',  d'),  by 

oo 

=  X 

n,  m=  1 


where 


d 

nm 


JJ  4>^(t)  4)  dt  d4 

(t.  4)  eR^ 


(3.  2b) 
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The  coefficients  c  and  d  can  be  evaluated  by  the  dual  networks 

nm 

shown  in  Figure  3.  3c  and  F'igure  3.  3d,  respectively. 

It  is  important  to  notice  that  for  a  given  system,  the  single 
Fourier  transform  of  the  expansion  of  k(t,  t)  given  by  Equation  (3.  15) 
is  of  the  form  of  the  expansions  of  Equation  (3.  23)  or  Equation  (3,25), 
and  the  double  transform  of  k(t,  v)  is  of  the  form  of  Equation  (3.  21); 
hence, 

a  =  b  =  c  =  d  ,  (3. 

nm  nm  nm  nm  ' 


and  the  outputs  of  the  four  systems  of  Figure  3.  3  are  the  same. 

By  considering  two  dimensional  systems  such  as  optical  systems, 

radar  systems,  or  acoustical  systems,  one  may  obtain  a  coefficient 

evaluation  scheme  that  is  the  direct  two  dimensional  analogy  of  the 
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scheme  introduced  by  Huggins.  The  input-output  relation  for  a  two 
dimensional  system  is 


k(pj,  p^,  u^,  u^) 


x(u^,  U2)du^  du^ 


(3.  28) 


where  k(p^,  p^,  u^,  u^)  gives  the  output  at  coordinates  (p^,  p^)  due  to 

an  impulse  at  the  coordinates  (u,,  u,)  .  The  coefficient  a  is  the 

1  c.  nni 

output  at  the  coordinates  (n,  m)  of  the  system 

sin(p.-n)  sin(p^-m) 

^  ^  /  -i  ->ri\ 


n,  m=  1 


(P^-n)  (P2-ni) 


1,/r.. 


'2’  “1’ 


.  \ 
‘2' 


V 

/ 


m 


Vu- 


when  the  input  is  k(t,T)  . 
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The  choice  of  the  sets  and  (*■)  for  a  given  function  of 

two  variables  is  important,  in  that  a  judicious  choice  may  give  a 
truncated  expansion  that  has  fewer  terms  for  a  given  error.  For 
example,  a  degenerate  kernel  such  as  sin  x  sin  y  on  (0,  Ztt)  x  (0,  Ztr) 
should  be  recognized  as  its  own  expansion  in  terms  of  the  sets 


^  ^sinkx,  cos  kx^ 


(3.  30) 


If  the  complete  sets  are  eigenfunctions  of  the  kernel  k{t,  r)  ,  then 
the  expansion  contains  no  crossterms.  From  the  kernel  k(t,  t),  one 
can  construct  the  symmetric  kernels 


k'(t.  T) 


k"(t,  t) 


U. 

j  k(t,u 


)  k(T,  u)  du 


j  k(u,  t)  k(u, 


t)  du 


(3.  31) 


There  exists  a  sequence  of  pairs  of  eigenfunctions  and  associated 
eigenvalues  such  that 

d 

4>^{t)  ""  j 

c 

b 

4'^(t)  =  \^  I"  k(T,  t)  4)^(t)  dr 
a 

b 

4>y(t)  -  J k(t,  t)  <p^(t)  dT 

a 
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(3.  32) 


4>y(t)  :  /  k"(t,T)  dT 


The  sets 


of  k(t,  T)  is 


are  complete;  the  coefficient  of  the  expansion 


^  j  ^  ^  4> 

1  \c  /a 


4>  (t)4>  (t)  6 

n  m  nm 

m  m 


(3.  33) 


oo 

"■I 


4>  (t)  4-  (T) 

m 


(3.  34) 


Furthermore,  if  the  right-hand  side  converges  uniformly,  then  it 
converges  uniformly  to  k(t,T)  , 

In  the  case  where  k(t,  t)  is  symmetric,  .  If  the  eigen 

values  are  positive,  the  expansion 


k(t,T) 


<|)  (t)  4)  (T) 

^m  ^m' 


(3.  35) 


m=l 


converges  uniformly  in  both  variables,  according  to  Mercer's  theorem. 


D.  S^'WTHESIS  BY  DOUBLE  EXPANSION 


Consider  the  double  expansion  of  the  svstem  functior  h(t  v) 


in  terms  of  the  complete  sets  }  ' 

oo 

h(t,  v)  -=  /  a  4j  (t)  4^  (v) 

'  /  ^  nm  m'  ^m 


(t)  4>  (v) 

i'  ^m 


(3.  36) 


n,  m=  1 
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Tb.i.j  iD'i  ' vj.l<d  i>ii  a  rectangle  K  \Aherc  '+'^^(0  i -i  redii/db'lc 

<i..~  the  itnpulae  re  ;{.'v.'!,-5e  <,il  a  ti  liie  •  in  va  r  ia  nt  sv'^tem.  The  trancated 
expansion  is  realizable  at  a  parallel  combination  of  H-^eparable 
r.eta/Oil<'>  in  which  a  typical  braiich  consist.s  of  a  netvmrk  of  impulse 
respor.ae  followed  t>y  a  mnltiplier  ' 

For  example,  consider  the  particular  system  function 
To  t<T  (-'r  t^O, 


i<(',  r) 


(3.  37) 


S(t-2T) 


otherwise 


where 


S(x) 


A 


^u_j(x)  -  u_^(x-a)^ 


(3.  38) 


For  srnill  A  this  system  function  is  an  approximation  of  a  time-varying 
delay  system  with  delay  T.  The  range  (0,  T)  x  (C,  T)  of  the  k(t,  r) 
function  corresponds  to  the  range  R  -  (0,  T)  x  (0,  T/2)  of  the  h(t,  vl 


iur.c*’.icr  ,  where 

0 

h(t,v)  :  < 

S(  Zv-t) 


V  <  0  or  t  <  0 


tdhe  r  wi  se 


39) 


Figi.rt;  J,  3  shows  a  phot  of  the  h(t,  v)  function  ot  Equation  (3.  39). 

Ta^'e  Hie  complete  sets  on  the  ranges  (0,  T)  and  (0,T/2),  respectively. 


tt  be 
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Then 


h(t,  v)  dv 


(2-Tm 
1  -e  ) 


j  Z-rrmt 


j  4TTmA 


(3.4i) 


T  T/2 


h(t,v)  4^_j^(v)  dv  dt 


(Z-rrmA  \ 

l-e'  -  j 


j  4TrmA 


m,  -n 


(3.42) 


The  expansion  of  h(t,  v)  on  R  is 
oo  /  _ 

wt.v)  =  ^ 


jZ-fimt  j4iTnr\v 


i  4'n-nnA 


m=  -oo 


(3.43) 


The  cross  terms  are  all  equal  to  zero  because 

^j2Trmt/T  shown  by  Equation  (3.41)  to  be  eigenfunctions  of  the 

kernel  h(t,  v)  . 


Taking  the  transform  of  Equation  (3.43)  with  respect  to  v  yields 


H(t,\) 


I’ 


ry.  Trm  . 
T  sin  A 


jtrmA  jZumt 

T  T 

e _ e _ 

.  4TTm 
\  +  1  -  -?r- 


OO 

T  5 


Trm  I 

.  in  T  ^  j  ^  I  ^rrmt  ,  n-m  , 
ZTrrnA  /cosj^  ^  ‘•'T 


/Zrrmt  irm  ' 
+  sinl — A 


Srrm 

T 

2  ,  /4-rrm 
X  + 


(3.44) 


-50- 


The  expansion  of  H(t, \)  in  Equation  (3.44)  makes  evident  the  reali¬ 
zation  of  H(t,  X.)  as  a  parallel  combination  of  h-separable  networks, 
as  shov/n  in  Figure  3.  6,  in  which  a  typical  branch  consists  of  the  net¬ 
work  with  transfer  function 


X 


2 


followed  by  the  multiplier 


.  TTTn  ^ 
T  sin  A 

irm  A 


(Zirmt  ,  irmA 


or  the  network  with  transfer  function 


/4'trm\‘ 

M 


followed  by  the  multiplier 


4  sin 


Tim 


sin 


(2  irmt  ,Tm  A 

T 
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FIGURE  3.  6  Realization  of  h(t,  v) 


IV.  APPLICATIONS  OF  EXPANSIONS: 
THE  MATRIX  APPROACH 


A,  INTRODUCTION 

The  expansion  of  system  functions  and  inputs  in  appropriate 
series  can  lead  to  the  conversion  of  integral  relationships  to  matrix 
relationships.  The  matrix  relationships  are  in  some  ways  easier  to 

9 

handle.  The  inversion  problem  was  solved  by  Marcovitz,  who  used 
the  matrix  approach.  Matrix  methods  can  be  successfully  applied  to 
the  eigenvalue  and  eigenvector  problem. 


B.  MATRIX  CHARACTERIZATION 


Consider  the  input-output  relationship 
d 

y(t)  =  f  k(t,  r)  x(t)  dr 


(4.  1) 


According  to  Chapter  III,  one  can  expand  k(t,  t)  in  the  series 


E 


k(t,  t)  =  )  a  (t)  4*  (t) 

'  '  nm  ^n'  m 

h,  m 


(4.2) 


on  (a,b)  X  (c,d)  .  The  input  is  expanded  on  the  interval  (c,d)  by 


C(T)  =  ^^.+  .{7) 


{4.  3) 
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The  input-output  relationship  now  becomes 


y(t) 


Zd 

a  b  *  (t)  / 
nm  j^n'  '  J 


n,  m,  j 


c 


+  (t)4'.(t)  dr 

m  1 


(4.4) 


The  right-hand  side  Equation  (4.  4)  is  the  expansion  of  the  output  y(t) 
on  the  output  time  interval  (a,  b)  .  The  coefficient  of  the  expansion  of 
the  output  is 


c 


n 


I 


a  b 
nm  m 


(4.  5) 


The  coefficients  of  the  output  expansion  are  related  to  the  coefficients 
of  the  input  expansion  by  the  matrix  equation 


[c]  =  [a]  b] 

where 


o 

o 

*0 1 

*0  2 

*10 

*11 

*12 

*21 

*22 

(4.  6) 
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^0 


(4,7) 


One  should  notice  that  if  the  sets  eigen¬ 

functions  of  the  kernel  k(t,T),  as  defined  by  Equation  (’  32),  then  the 
expansion  of  Equation  (4.  2)  reduces  to  the  expansion  of  Equation  (3.  34). 
Thus  the  systenn  matrix  A  is  seen  to  be  diagonal  with 


J_ 

X 

m 

a  =  < 

nm  1 


for  n  =  m 


(4.8) 


^  0  for  n  /  m  , 

and  the  relationship  between  the  input  and  output  coefficients  becomes 
simply 


c 

n 


b 

n 

X“ 

n 


(4.9) 


When  the  series  of  Equations  (4.  2),  (4.  3),  and  (4.  4)  are  sampling  series 
of  the  form  of  Equations  (3,  3)  and  (3.  5),  then  for  sampling  in  the 
quadrant  where  t,  t  ^  0  , 

a  =  W  =  kfiT  iX  i  iA  ■in\ 

-ij  -ij  ^ - ^ 

By  the  causality  condition, 


k.  .  =  0  for  j  ^  i 
ij  ■' 


(4.  11) 
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''•iKlOil 


Therefore,  the  system  matrix  is  triangular 


0  0 


k  Ic 

10  11 


0  0 


^20  ^21  *^22  ° 


(4.  12) 


The  input-output  relationship  equation  becomes 


[k]  .] 


(4.  13) 


where 


(4  14) 


are  the  coefficients  of  the  output  and  the  input  with  samples  taken  at 

intervals  of  T^  and  T^  sec  ,  respectively. 

The  column  of  the  system  matrix  [K]  has  the  particular 

significance  of  being  the  output  sampled  at  every  iT^  sec  due  to  a  unit 

th 

impulse  input  applied  at  time  jT^  .  Similarly,  the  j  column  of  the 
system  matrix  [A]  gives  the  output  coefficients  due  to  an  input  ip.(t)  . 
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C.  THE  INVERSION  PROBLEM 


The  inversion  problem  consists  of  finding  a  system  which,  when 
placed  in  cascade  with  a  given  system,  makes  the  over-all  syst^-m  unity. 

It  arises  in  many  applications,  i.e.  signal  recovery,  feedback  systems, 
and  in  relating  time -varying  impedance  and  time -varying  admittance 
functions . 

The  two  systems  in  cascade  shown  in  Figure  Z.  1  have  an  over¬ 
all  system  function  K^(s,  t)  .  From  the  definition  of  the  K^(s,  t)  sys¬ 
tem  function,  a  unity  system  has  the  response  function 

K^(s,t)  =  .  (4.15) 


Solving  the  inversion  problem  is  then  equivalent  to  solving  the  integral 
equation  of  the  over-all  K^(s,  t)  function 


oo 

e'®’^  =  J  u)  k^^^{u,  t)  du 

-oo 


(4.  16) 


for  the  left-hand  system  function  k'^^(t,  r),  or  the  right-hand  system 
function  t),  when  the  ether  system  function  is  given.  Not  only 

it  is  difficult,  in  general  to  solve  Equation  (4.  16)  for  the  inverse  system 
function,  but  it  is  also  difficult  to  tell  when  solution  exists  at  all.  For 
a  time-varying  delay  system,  it  is  possible  to  find  a  condition  under 
which  an  inverse  system  function  exists  and  to  find  the  inverse  system 
function  itself.  Let  the  left-hand  system  be  a  delay  system  with  c  elay 
a(T)  ; 
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6(t  -  T  -  a(T)) 


(4.  17) 


(t,  t)  = 


Also,  let  the  notion  of  inversion  be  extended  to  allow  the  over -all  system 
to  have  a  constant  delay  response  rather  than  a  unity  response.  Then 
Equation  (4.  16)  becomes 

^-s(t  +  D)  ^  (s,t)  6(t  -  T  -  a(T))  dt 

=  (s,  T  +  a(T))  (4  18) 

where  the  delay  constant  D  is  chosen  to  assure  realizability  of  the 
inverse  system.  Thus, 

k^^\t.  T+a(T))  =  6(t  -  T  -  D)  .  (4.19) 

In  order  to  solve  for  the  right-hand  inverse,  T  +  a(T)  must  be  invertible 
(i.  e.  strictly  monotonic  in  t)  ,  in  which  case 

k<^Mt,  T)  =  6(t  -  x(t))  (4.20) 

where 

x(t  +  a(r))  =  T  +  D  (4.  21) 

From  the  form  of  Equation  (4  21)  it  is  seen  that  the  right-hand 
inverse  is  a  delay  system  with  delay  x{t)  -  7.  For  example,  if  a(T)  =  r 
then  x(t)  -  T  '  t/2  +  E  -  t  =  D  -  T/ 2  .  Note  that  if  D  =  0  ,  delay  by  t 
in  the  left-hand  system  is  compensated  for  by  prediction  of  t/2  in  the 
right-hand  inverse  system.  If  the  input  to  the  first  system  is  zero  for 
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T  >  D  ,  the  right-hand  inverse  is  a  realizable  delay  system  (i.  e.  no 
prediction).  Thus  D  must  be  chosen  large  enough,  depending  on  the 
input,  so  that  the  right-hand  inverse  will  be  realizable.  As  another 
example,  delayby  a(T)  =  -  t  is  compensated  for  by  delay  of 

D  -  (t  -  =  D  +  -  T  . 

For  a  simple  example  where  the  right-hand  inverse  system  func¬ 
tion  does  not  exist,  take  a(T)  =  D  -  t  .  Then  t  +  a(T)  =  D  ,  which  has 
no  inverse.  The  physical  explanation  for  this  is  that  the  first  system 
delays  the  input  6(t  -  t)  by  D  -  t  ,  giving  an  output  6(t  -  D)  as  the 
input  to  the  second  system.  The  second  system  sees  the  same  input 
for  every  value  of  T  and  obviously  has  an  output  that  cannot  depend 
on  the  value  of  t  :  hence  the  output  cannot  be  6(t  -  t  -  D)  . 

If  the  right-hand  system  is  given  as  a  delay  system  with  delay 
b(t)  ,  then 


<4.  22) 


Equation  (4.  16)  now  becomes 


i(T  +  D)  ,  k<‘>(t,T)dt 


(4.  23) 


If  t  +  b(t)  is  invertible,  there  exists  a  function  y(t)  such  that 
y(t  +  b(t))=  t  .  Now  the  change  of  variables  t  +  b(t)  =  u  can  be  made 
in  Equation  (4.  21)  ,  giving 


[t  +  r  -su 

=  r 


k'  '  (y(u),  t)  y'(u)  du 


(4.  24) 
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Taking  the  transjform  of  Equation  (4.  24)  with  respect  to  s  yields 


6(t  -  T  -  D)  =  Jb{t  -  u)  k^^^(y(u),r)  y'(u)  du 

=  y'(t)k'^V(t)  r)  ;  (4.25) 

thus, 

k<^)(t,  T)  =  Mt  +  b{t)-T-D)  .  (4.26) 

For  example,  if  the  second  system  has  delay  b(t)  =  t,  then  y{t)  =  t/2, 
and 

k^^V.  T)  =  2  6(2t  -  T  -  D)  .  (4.  27) 

3  1/3 

As  another  example,  let  b(t)  =  t  -  t;  then  y(t)  =  t  '  ,  and 

k^^V,T)  =  3t^  6(t^  -  T  -D)  .  (4.28) 

A  simple  example  of  the  nonexistence  of  an  inverse  is  when 
b(t)  -  D  -  t  ,  in  which  case  b(t)  +  t  does  not  have  an  inverse.  It  should 
be  noted  that  by  using  s ystem -function  duality,  the  discussion  here  is 
made  equally  pertinent  to  the  finding  of  the  inverses  of  a  selective  fre¬ 
quency-shift  <^ystem. 

The  matrix  approach  can  be  used  in  the  inversion  problem  with 
a  good  deal  of  success.  For  the  system  with  a  matrix  A  followed  in 
cascade  by  the  system  with  matrix  B  ,  the  over-all  system  matrix  is 
BA  .  The  right  hand  quasi-inverse  to  the  system  K  of  Equation  (4.  12) 
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is  defined  as  the  system  K'  so  that 


K'K  = 


(4.29) 


The  system  K  followed  in  cascade  with  the  system  K'  is  an  identity 
within  a  finite  amount  of  delay  (finite  lumber  of  rows  of  zeros).  The 
matrix  K  maybe  finite  or  infinite. 

The  necessary  and  sufficient  conditions  for  the  existence  of  a 

9 

quasi-inverse  are  due  to  Marcovitz.  Using  the  following  notation: 


is  the  i  x  i  submatrix  of  K  containing  the  first  i  rows 
and  i  columns, 

is  the  submatrix  of  containing  the  first  i  columns, 

and 


K!. 

U 


is  the  submatrix  of  K.  , . 

i+J 


containing  the  last  j  columns, 


Marcovitz' s  main  theorem  states  that,  if  the  rank  of  K.  .  is  r  ,  the 

i+J 

necessary  and  sufficient  conditions  for  the  existence  of  a  quasi-inverse 

with  j  units  of  delay  are  that  the  rank  of  K! .  be  r  -  i  .  The  theorem 

ij 

verifies  the  obvious  facts  that  a  sufficient  condition  for  the  existence  of 
an  inverse  is  that  the  terms  on  the  main  diagonal  are  nonzero,  i.  e. 


k..  4  0 
11  ' 


(4.  30) 


and  that  the  sufficient  conditions  for  the  existence  of  a  quasi-inverse 
with  minimum  delay  j  is  that  the  main  diagonal  and  the  j  -  1  diagonals 
below  it  be  zero  and  that  the  diagonal  below  it  have  all  nonzero 
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terms ;  i .  e . 


Ku.l  °  tor  i  <j,  (  =  0,1, Z, 


^j  +  Z  Z  ^  ^  ^  =0,1,2,.., 


(4.31) 
(4.  32) 


The  necessary  and  sufficient  conditions  for  existence  of  a  unique  quasi- 
inverse  are  also  given  by  Equations  (4.  31)  and  (4.  32). 

An  interesting  corollary  is  that,  if  the  first  j  diagonals  are  zero 
as  in  Equation  (4.  31)  and  if  I  ^  ^  some  value  of  /,  then  a 

necessary  condition  for  the  existence  of  a  quasi-inverse  is  that  I  ~  ^  ' 

either  for  an  infinite  number  of  Z  or  for  no  Z  at  all. 

Application  of  the  main  theorem  may  be  difficult  because  it  may 
require  an  infinite  number  of  calculations.  The  calculations  must  be 
applied  for  each  value  j  of  delay  until  one  is  found  vdiich  works.  If 
there  is  no  value  of  j  for  which  the  conditions  are  satisfied,  the  quasi - 
inverse  does  not  exist. 


1.  Finite  Matrices 

Finite  system  matrices  occur  in  coding  systems  and  in  the  time- 
limited  approximations  to  the  system  matrix.  For  an  input  that  is 
t  units  long,  one  need  be  concerned  with  only  the  first  t  columns  of 
the  system  matrix  K.  The  quasi-inverse  with  respect  to  an  input  t 
units  long  exists  if,  and  only  if,  the  rank  of  is  t,  where  K^,  is 

the  matrix  of  the  first  t  columns  of  K.  The  maximum  delay  in  recover¬ 
ing  the  input  is  given  by  the  number  of  the  last  of  the  t  independent 
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r  ws  of  ,  where  the  first  row  is  numbered  zero.  If  some  of  the 


input  digits  are  zero,  then  one  should  consider  the  submatrix  of 

,  where  the  matrix  of  the  r  columns  of  K  which  correspond 

to  the  r  nonzero  digits  of  the  input.  Since  there  may  be  cases  where 

the  rank  of  K  is  not  t  ,  but  the  rank  of  K,  .  is  r,  the  quasi-inverse 

with  respect  to  a  t  digit  input  that  has  some  zeros  may  exist  when  the 

quasi -inverse  with  respect  to  a  t  digit  input  does  not  exist. 

Let  K  denote  the  finite  submatrix  of  the  infinite  matrix  K 
mr 

containing  the  r  columns  of  K  that  correspond  to  the  r  nonzero 

information  bits  of  the  t  digit  input,  and  terminating  after  m  rows. 

If  K  is  of  rank  r,  then  a  quasi-inverse  with  at  most  j  =  m-r  units  of 

delay  exists.  It  would  be  particularly  interesting  to  find  the  smallest 

value  of  m  for  which  the  matrix  K  has  rank  r  so  that  the  delay 

mr  ’ 

in  signal  recovery  is  th.,  shortest.  This  is  done  by  testing  the  rank  of 

sequentially  in  m  for  m  =  r,  r  +  1,  r  +  2,  ..  .  until  its  rank  is 

found  to  be  r  .  If  there  exists  no  value  o.”  m  for  which  the  rank  of 

is  r,  th^*n  the  quasi -inverse  does  not  exist  for  that  input. 

Let  K'  be  the  quasi-inverse  of  K  if  it  exists,  then 
mm  ^  mr 

0. 


K'  K 
mm  mr 


jr 


I 

L_  rr_j 


(4.  53) 


The  matrix  K'  can  be  augmented  to  be  a  quasi-inverse  of 
inm  ^  ^ 

the  system  matrix  K  with  respect  to  a  particular  input: 


t 

K  = 

K" 

0 

m+z,  m 

(4.  34) 
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where 


z  -  t  -  r 


(4.  35) 


and  K"  ,  is  K'  with  z  rows  of  zeros  added  to  correspond  to 

m+z,  m  mm  ^ 

the  7.  zeros  in  the  input.  For  example,  if  m  =  5  and  z  =  3  and  the 

zeros  occurred  at  the  0^^,  3***^,  and  digits,  then  the  0^^,  3*"*^,  and 

5  rows  of  K  '  -  are  zero,  and  the  1  ,2  ,4  ,6  ,  and  7 

m+3,  m  .  .  I  • 

£  vx,  ..L  jSt  ..nd  _rd  .th  ,  _th  ,  ,,, 

rows  of  K  '  ,  are  the  1  ,2  ,  3  ,4  ,  and  5  rows  of  K'  , 

m+3,  m  ,  ,  ,  , 

respectively.  Enough  columns  of  zeros  are  added  to  ^  to  make 

the  matrix  K'  compatible  with  : 

0 


K'K 


jt 


(4.  36) 


where  has  ones  on  the  main  diagonal  corresponding  to  the  nonzero 

digits  of  the  input  and  has  zeros  elsewhere.  From  Equation  (4.36)  one  sees 

that  when  the  input  is  passed  through  the  system  K  followed  by  the 

system  K',  the  output  is  j  units  of  zero  followed  by  the  input.  The 

recoverability  of  a  t  digit  input  is  therefore  dependent  on  the  existence 

of  a  quasi -inverse  to  the  finite  matrix  A 

^  mr 


2.  The  Inverse  in  Feedback  Systems 
The  response  to  the  feedback  sy.stem  of  Figure  4.  1  can  be  ob¬ 
tained  from  the  equation 

6y  =  kAX  +  .  (4.37) 
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xo- 


1 - 

B 

FIGURE  4.  1.  Feedback  System. 


where  means  the  system  function  operating  on  x.  Equa¬ 

tion  (4.  37)  can  be  rewritten  as 

(6  -  kg  ®  k^)y  =  k^x  .  (4.  38) 


Thus, 


y  = 


(6  -  kg  ®  k^)  ’  ^  ®  k^  I  X  =  kx 


(4.  39) 


The  inverse  to  (6  -  kg  ®  k^)  must  be  found  in  order  to  find  the  over-all 
system  function  k  .  In  matrix  notation  convolution  is  replaced  by  matrix 
multiplication  and  the  system  matrix  is  given  by 


K 


(I  -  BA)’^  A 


(4.  40) 


where  B  and  A  ^.re  the  system  matrices  of  kg  and  k^  ,  respectively. 
By  using  the  methods  given  earlier  in  this  section,  one  can  find  the 
inverse  of  I  ~  BA  if  it  exists.  If  a  quasi-inverse  (I  -  BA)'  exists, 


(I  -  BA)'(I  -  BA) 


D 


Then 


DK  =  (I  -  BA)'  A 


(4.41) 


(4.42) 


The  first  j  rows  of  the  right-hand  side  of  Equation  (4.  42)  must  be 
zero. 


3.  Relationship  Between  Impedance  and  Admittance 
Functions  and  Equivalence  to  the  Inversion  Problem 

The  can  be  related  by  inserting  Equa¬ 

tion  (1.  26)  into  Equation  (1.27)  and  interchanging  integrals: 

(u,  T)duj  i{T)  dr  .  (4.43) 

By  the  uniqueness  of  Fourier  transforms, 

e'®^  =  jK^y(s,  a)  k^(u,  T)dii  (4,44) 


1(8) 


=  jK^yis,  u)  e{\i)du  =  j  Jk 


^y{B,  u) 


The  following  dual  relations: 


u)  kY(u,  t)  du 
=  jK2Y(t,  p)  K2(p.  \)dp 

Ky(p.X)  dp 


(4.  45) 

(4.46) 

(4.  47) 
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are  obtained  by  physical-quantity  duality,  system-function  duality  and 
complete  duality,  rebpectively.  These  relationships  can  also  be  writ¬ 
ten  in  tf  rms  of  G  and  H  functions  by  using  identities.  By  comparison 
of  Equations  (4.44)  through  (4.47),  the  problem  of  finding  an  impedance 
driving-point  system  function  from  ar  admittance  driving-point  func¬ 
tion,  or  vice-versa,  is  seen  to  be  equivalent  to  finding  a  left  or  a 
right  inverse  system  to  a  given  system. 


D.  MINIMUM  DISTORTION  SIGNALS  AND  SYSTEMS 


The  problem  of  finding  signals  that  will  pass  through  a  given 
system  without  distortion  other  than  a  multiplicative  constant  is  an 
eigenvector  problem.  From  the  input-output  relationship  of  Equa¬ 
tion  (4.  13),  one  sees  that  the  zero -distortion  inputs  are  the  eigen¬ 
vectors  of  the  following  characteristic  equation: 


(4.  48) 


Since  K  is  triangular,  the  eigenvalues  are  clearly 


.1 


(4.  49) 


The  eigenvector  corresponding  to  the  eigenvalue  is 


/..(j)  ..(j)  „ 
\^1  '  ^2  ’  *3  ’ 


e  A  r  />  \ 


V*.  3u; 


One  may  assume  that  the  eigenvalues  are  all  nonzero,  as  the  zero 

(Jq) 

eigenvalues  are  of  no  interest.  The  e  genvector  x  can  be  found 
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by  an  iterative  method.  If  is  not  repeated,  i.e. 

Jq 


“joJo  ^  ^ 


(4.51) 


Oq) 

then  the  components  of  x  can  easily  be  solved  for 


(Jn) 


f  0  for  k=  1,2,  ....Jq-I 


X.  for  k  = 


Jo 


k-  1  a,  .X. 

E 


(Jo) 


1- 


JQ  jo‘^k 


for  k  =  Jq  +  I, 


(4.52) 


(JO^ 

where  x.  is  an  arbitrary  constant. 

Jq 

If  X..  is  repeated,  assume  it  occurs  first  at  k..  .  The  matrix 
J  JJ 

A. .  ,  where 
JJ 


JJ 


^11 


ll 


k,  .  .  .  .  k, . 

Ij  JJ 


(4.  53) 


has  the  eigenvector  {0,...,0,x^}  corresponding  to  with  x^  chosen 

arbitrarily.  The  matrix  A...  ...  has  the  eigenvector  {O,  .  .  .  ,  0,  x.,  x.  .  *  } 

J  +  itJ+i  J  J  +  i 

corresponding  to  Xj  ,  where  determined  by  the  equation: 


(X.  -  X,  ^  .)x  ^  .  =  k.  .  .X. 

J  J  +  1  J  +  1  J>J  +  1  J 


(4.  54) 
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if  Xj  /  •  B'it  if  =  ^j  +  l*  either  k^  or  Xj  must  be 

rbitrary,  but  if  k.  .  ,  .  is  nonzero, 

J.J  +  1 


zero.  In  either  case  x.  .  .  is  a 

J  +  i 

Xj  is  no  longer  arbitrary  and  must  in  fact  be  zero. 


Suppose  the  first  repetition  of  X.^  occurs  at  •  then  the 


eigenvector  of  A.  .  .  .  is 

*  j+r,j+r 


^j+r-l-'^j+r 


where  *j+2’  •  •  •  »  ’^j+r  1  been  computed  by  considering  the 

eigenvectors  of  in  the  matrices  A.  .  ...,A.  _  A..  ,  .. 

*  J  j  rl,j  +  l’  j+2,j+2’  j+r-l,  j+r-1’ 

respectively.  The  new  component  x.  is  determined  by  the  equation 

J 


(\ .  “  X  ,  )x. 

J  J+r  J  +  r 


j+r-1 


j+r 


(4.55) 


Since  the  left-hand  side  of  Equation  (4.  55)  is  zero,  arbitrary. 

But  if  the  right-hand  side  is  not  zero,  then  must  be  zero,  in  which 
case  Xj^^,Xj^2>  •  •  •  ’  ^j+r  1  zero.  Similarly,  if  the  next  repe¬ 

tition  of  X.  occurs  at  X..  then 
J  J+r+t 

j+r+t-1 


I 

7 


,  j  +  r+t 


must  be  zero  and  is  arbitrary.  Since  the  right-hand  side  of 

Equation  (4.  55)  is  zero,  this  is  equivalent  to  saying  that 
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jt^-1 

Z 

I  -j+r 


X, 

j+r+t  I 


must  be  zero.  If  it  is  nonzero,  then  must  be  zero,  in  which  case 

X.,  ,  are  all  zero.  This  process  is  now  continued, 

j+r  +  1  j+r+t-1  ’ 

and  it  is  clear  what  happens  at  the  next  repetition  of  . 

It  may  be  possible  that  all  eigenvectors  of  a  given  infinite 
matrix  may  be  zero,  as  in  the  matrix 


K  = 


1 

1  1 
1 


11 


(4,56) 


In  finite  triangular  matrices  where  eigenvalue  is  repeated  J  times, 

J 

there  is  at  least  one  nonzero  eigenvector  because  the  component  at 
the  place  of  the  last  repetition  is  arbitrary.  Also,  the  number  of  zero 
eigenvectors  is  equal  to  the  number  of  times  during  the  iterative  pro¬ 
cess  that  a  previously  arbitrary  component  was  forced  to  be  zero. 

In  a  system  whose  matrix  has  more  rows  than  columns,  the 
output  that  is  desired  for  minimum  distortion  is  the  input  followed  by 
zeros: 


Kxl 

TT 


k  • , 

;  • 

k.  .  .  .  k 
In  nm 

k.  .  .  .  k 
Im  nm 


x 


n 


(4.  57) 
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Generally  one  cannot  solve  Equation  (4.  57)  because  there  are  more 

^Im 

,0) 


equations  than  unknowns.  But  if  the  row  vectors  k.  ,  .  .  .  ,k  for 

Im  nm 


m  >  n  are  orthogonal  to  a  particular  eigenvector  x'’''  of  the  matrix 
A  ,  the  equation  is  satisfied  where 


A  = 


11 


‘In 


ll 


nn 


(4.  58) 


Note  that  if  x^"^^  is  the  eigenvector  of  matrix  A  of  \^  =  k^^  ,  and 

is  the  eigenvector  of  its  transpose  conjugate  matrix  A*  corresponding 

. ,  =  k,  ,  ,  and  if  X. .  ^  \ , 

III  J  t 


to  =  ,  and  if  X..  ^  \  ,  ,  then  x^-^^  and  y^^^  are  orthogonal: 


=  (Ax<j>.y<'')  .  . .  {x<«,  y<' >) 


.  (4.59) 


Since  ^  ' 


(xU',y<'>)  .  ,, 


(4.60) 


If  X^  /  Xj  for  i  /  j  ,  then  A  is  diagonable  and 

,-l 


TAT 


‘11 


li. 


nn 


(4.61) 


V.  .U  th 

where  the  j 

mliimn  nf 

T  is 

stnci 

For  this  case 

the  infinite 

matrix 

"a 

0  ■■ 

K 

w 

V  6 

B 

•th 


1  T' 

J  *  W  W  W  »  A 


-1  . 


,.(j) 

J 


(4.62) 
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where  the  rows  of  W  are  for  I  ^  j,  passes  the  signal 

without  distortion  because  0}  is  an  eigenvector  of  K.  Similiarly, 

(k) 

if  the  rows  of  W  are  made  up  of  y'  '  for  k  ^  j ^  •  •  •  >  j j.  .  then  the 

(Jl)  <j2)  Ur)  , 

system  will  pass  x  ,  x  ,  .  .  .  ,  x  without  distortion. 


E.  APPLICATION  OF  DOUBLE  SERIES  TO 
THE  EIGENFUNCTION  PROBLEM 


Matrix  methods  can  be  used  to  solve  the  eigenfunction  equation 
b 

\4/  -  f  k(t.  T)  ^(T)  dT  .  (4.63) 


One  can  expand  the  unknown  eigenfunction  in  terms  of  the  complete 
set  : 


A 


(4.  64) 


k=l 


Taking  the  terminated  expansion  and  substituting  it  into  the  eigenfunction 
equation  yields 

\  ^  aj^4>j^(t)  =  ^“k  J  •  (4.65) 

kTi  k=  1  a 


Now  multiplying  both  sides  by  and  integrating  gives 

N  b  b 

^  ^  r  r 

k=l  a  a 
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for  j=  1  ,  .  .  .  ,  N 


(4.66) 


.^jk"k 


where  is  the  (jk)^^  coefficient  of  the  expansion  of  k(t,  t): 


k(t,  ^  *jk 

j,  k=l 


(4.67) 


Thus,  the  integral  eigenfunction  equation  has  been  reduced  to 
the  matrix  eigenvector  equation 


).a]  =  [a]  a] 


(4.68) 


where 


N 


W 


‘"jk> 


An  approximation  can  be  made  to  the  eigenvalue  X.  and  to  the  coefficients 
of  the  expansion  of  the  eigenfunction  by  solving  the  matrix  character¬ 
istic  Equation  (4.68). 

Note  that  {4).}  need  not  be  complete  but  only  good  enough  to 
approximate  k(t,T)  and  4*  to  within  a  olerable  error.  When  the  {<|)^} 
are  approximating  rectangles,  this  method  reduces  to  the  Fredholm 
method  where  one  approximates  the  integral  by  a  sum  to  reduce  the 
integral  equation  to  a  matrix  equation.  One  advantage  of  this  method 
is  that  a  judicious  choice  of  the  set  may  lead  to  a  better  approxi¬ 

mate  solution  for  a  given  N  ,  or  a  smaller  N  for  a  fixed  amount  of 
error . 
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1.  Error  Evaluation 


By  the  completeness  of  the  set  }  and  by  Bessel's  inequality 
one  can  choose  N  so  large  that 


(4.69) 


N 

|k(.,r)f  .  y  ^  .  (4.70) 

j.k=l 


The  equation 


X.  a . 
J 


(4.71) 


gives  the  exact  solution: 


(4.72) 


and  the  equation 


Pk 


gives  the  approximate  solution; 


4)'  = 


1 


(4.73) 


/a  7a\ 

\  *  •  * 
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By  Schwartz's  inequality, 


and  Equation  (4.71)  can  be  rewritten 

N 

\  a.  = 

J 

1 


(4.75) 


(4. 76) 


As  N  becomes  increasingly  large,  Equations  (4.71)  and  (4.74)  be 
come  virtually  identical. 
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V.  SYNTHESIS  OF  TIME-VARYING  SYSTEMS 


A.  INTRODUCTION 


The  realization  of  the  double  expansion  of  h(t,  v),  as  demon¬ 
strated  in  the  example  of  Section  III  iJ,  is  applicable  to  the  synthesis 
problem.  The  function 


h(t,  v) 


/  a  (i>  (t)  4»  (v) 

/  ^  nm  n  m 

n,  m 


(5.  1) 


on  R  =  (a,b)  x  (c,  d)  ,  where  is  a  realizable  impulse  response, 

was  shown  to  be  realizable  as  a  parallel  combination  of  H -separable 
branches  with  a  typical  branch  consisting  of  the  network  of  impulse 
responses  followed  by  the  multiplier 

The  realization  by  double  expansion  has  certain  practical 
advantages  over  the  method  proposed  by  Cruz  and  Van  Valkenburg^^ 
in  which  h{t,  v)  was  realized  from  the  expansion  in  terms  of  the  com¬ 
plete  set  {v|j.  }  : 


h(t,  v) 


)  a  (t)  (v) 

/  m  m 


(5.2) 


where 


m 


u 


(v)  dv 


(5.  3) 


-76- 


The  multipliers  may  be  of  complicated  form  and  therefore  diffi¬ 

cult  to  build,  whereas  one  has  some  choice  over  the  sets  {4>  }  .  For 
example,  if  the  interval  (a,  b)  is  finite  one  can  choose  to  be 

sines  and  cosines,  in  which  case  the  multipliers  are  standard  modu¬ 
lating  networks.  Actually  if  one  were  to  arrange  Equation  (5.1)  as 


then  by  comparison  with  Equation  (5.  2), 


a 

m 


(t) 


y  a  4)  (t) 
/  nm  m 


(5.5) 


Equation  (5.  5)  is  seen  to  be  a  realization  of  the  multiplier  in 

terms  of  the  elementary  multipliers  • 

Conversely,  consider  the  single  expansion  of  h(t,  v)  in  terms 
of  a  desired  set  of  multipliers  {4>j^(t)}  : 


h(t,  v) 


<|>  (t)  p  (v) 


(5.6) 


where 


Pn^'")  =  J  b(t,  v)  4)^(t)  dt 


(5  7) 


The  network  of  impulse  response  Pj^Cv)  is  not  necessarily  realizable. 


The  rearrangement  o^  Equation  (5.  1), 


h(l,  v) 


I  (l-‘ 


n  !  m 


(5-8) 


by  comparison  with  Equation  (5.  6)  gives 


m 


P„(V)  =  nr, 

n  /  nm  m 


4'_{v) 


(5.9) 


The  truncated  expansion 

M 


P„(v) 


Z 

m=  1 


a  «i<  (v) 

nm  m 


(5.  10) 


gives  an  approximate  realization  of  in  terms  of  tne  realizable 

networks  .  This  approximation  is  arbitrarily  close  in  the  mean 

square  sense  for  M  sufficiently  large. 


B.  THE  CROSS-COUPLED  REALIZATION 


The  H-separable  realization  of  the  terminated  single  expansion, 


M 

V 


h(t,v) 

m=  1 


(5. 11) 


consists  of  M  branches,  each  containing  one  passive  network  followed 
by  one  multiplier,  whereas  the  H-separabie  realization  of  the  terminated 


Suggested  by  Prof.  N.  DeClaris 
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double  expansion 


M,  N 

v)  =  \  a  4)  (t)  (v) 

/  nm  ^n  m 

m,  n=  1 


(5.  12) 


consists  of  MN  branches,  each  containing  one  passive  network  fol¬ 
lowed  by  one  multiplier.  This  represents  an  increase  on  the  order 
2 

of  N  for  tiie  double  expansion.  There  is,  however,  a  great  deal  of 
redundancy  in  the  H-separable  realization  of  the  double  expansion 
which  can  be  eliminated  by  the  cross-coupled  realization,  as  shown 
in  Figure  5.  1.  The  cross -coupled  network  contains  M  networks 
and  N  mulapliers  with  a  coupling  array  linking  the  networks  and 
multipliers.  The  number  of  networks  and  multipliers  is  of  the  same 
order  as  in  the  realization  of  single  expansion. 

The  coupling  array  may  be  realized  in  a  number  of  ways.  Since 
Figure  5.  1  is  actually  a  flow  diagram,  there  must  be  a  summer  at  the 
input  to  each  multiplier.  After  scaling  the  largest  to  unity,  the 

potentiometers  at  the  inputs  to  the  summer  of  multiplier  (j).  are  set  to 
j^ikj  k-1  2  M’  tiiose  a.j^  that  are  negative  in  sign  are  first 

passed  through  an  inverter.  The  coupling  network  mav  be  a  one- 
element  kind  of  network  (resistive  for  lew  frequencies  or  capacitive 
for  high  frequencies).  This  network  must  have  M  inputs  and  either 
N  outputs  of  the  form 


a  .  .  4* 

ij  J 
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or  NM  outputs  of  the  form  a  d*  .  The  latter  is  obtainable  by 

nm  m  ' 

tapping  unity  resistors  of  input  voltage  t)'  a-f  values  la  )  and  in- 

m  I  nm  I 

verting  the  coefficients  of  negative  sign.  Summers  must  still  be 

built  at  the  inputs  to  the  multipliers,  whereas  summation  is  done  by 

the  networks  in  the  former  case,  but  the  class  of  coefficients  {a..} 

ij 

for  which  this  network  can  be  synthesized  is  limited  by  the  realiza¬ 
bility  conditions  on  the  network. 


C.  BILINEAR  FORM 

It  is  useful  to  think  of  the  realization  of  the  truncated  expansion 
of  Equation  (5.  12)  as  the  realization  of  its  corresponding  bilinear  form; 


Mt.v)  -  4>]n 


(5.  13) 


where 


Am  =  . V 


=  {a  } 
NM  nm 


^]n 


4>l' 


<1>-  - 


(5.  14) 


One  can  identify  the  form  of  Equation  (5.  13)  with  the  structure 
of  the  realization  of  Figure  5.  1  with  the  c  rc ss -coupling  network  cor¬ 
responding  to  the  matrix  -  A.,.,. 

®  NM  MN 


-g  1  - 


Suppose  that  the  set  is  the  orthonormalization  of  a  minimal 

complete  set  {  9^}  and  the  set  {4>j}  is  the  orthonormalization  of  a 
minimal  complete  set  (Vj)  »  then  and  are  a  linear  com¬ 

bination  of  the  first  M  0/s  and  the  first  N  Y-'s,  respectively: 


JL  M  ■  ^  M  ^MM 

""  ^NN  y]n  ■  (5.15) 


Since  the  sets  are  minimal  complete,  the  matrices 
are  invertible,  and 


®MM  ^NN 


h(t,  v) 


^  M 


®MM ^MN^NN 


4 


(5.  16) 


The  new  cross-coupling  matrix  is 


MN 


®MM  “^MN  ^NN 


(5.17) 


In  particular,  suppose  the  are  the  orthonormalization 

of  a  set  of  exponentials, 


{e,} 


(5.  18) 


One  can  easily  synthesize  a  ladder  network  whose  poles  are  s^,  .  .  .  ,  s^  . 
The  outputs  of  M  rungs  of  the  ladder  are  linear  combinations  of  ex¬ 
ponentials  of  the  pole  frequencies: 


4IL 


M 


M  ^MM 


(5.  19) 
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One  can  choose  M  independent  rungs  of  the  ladder  so  that 
invertible.  Now, 


1 


FIGURE  5.^.  Realization  of  h(t,  v)  with  One  Passive  Network. 


For  the  case  where  M  =  N  ,  an  interesting  N-port  synthesis 
problem  arises.  If  one  could  synthesize  a  network  with  poles  at 
‘  ‘  input  port  tnd  N  output  ports,  and  with  the 

zeros  of  the  output  ports  chosen  in  sucn  a  way  that 


Q 


MM 


a: 


MM 


(5.22) 


then 


MM 


=  I 


(5.23) 


and  the  coupling  network  consists  only  of  wires  connecting  to  . 


D.  APPROXIMATION  IN  ONE  DIMENSION 


The  bilinear  form  approach  can  be  used  in  the  one-dimensional 

approximation  problem  when  the  expansion  in  one  dimension  can  be 

put  into  a  bilinear  form  with  both  variables  the  same.  If  both  {«|j^)  and 

{4).}  are  exponential  sets,  then  h(t,  t)  of  Equation  (5.  20)  is  expanded 
^  (Sm  +  s^)t 

in  terms  of  the  exponentials  e  with  coefficients  a  .  The 

^  nm 

realization  of  h(t,  t)  is  an  MN  term  expansion  of  h(t,  t)  obtained  by 
using  a  network  with  M  poles  and  N  multipliers. 

For  example,  the  network  of  Figure  5.  3  is  a  16-term  reali¬ 
zation  containing  a  network  whose  poles  are  s  =  0,  -2,  -4,  -6  and  mrlti- 


-8t  -16t 


oliers  1,  e  ,  e 


\ 


-24t 
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E.  REALIZATION  BASED  ON  SAMPLING  EXPANSION 


The  realization  of  the  sampling  series 
oo 

k(t,  t)  =  sine  2ttB 


{'■is) 


(5.25) 


using  a  delay  line  and  a  summer,  as  shown  in  Figure  5.  4,  was  proposed 

4 

by  Kailath.  A  similar  realization,  based  on  the  link  structure,  is 
shown  in  Figure  5.  5.  The  advantage  of  the  link  structure  is  that  the 
summation  is  performed  by  the  plate  delay  line. 

The  impulse  response  of  the  link  structure  for  A=  1/2B,  is 


k(t,  t) 


+  (j  +  1) 


sine 


(5.26) 


The  expansions  of  Equations  (5,  25)  and  (5.  26)  are  identical  when 


aj^T  +  (j  +  l)^j  = 


(5.27) 


Since 


1=0 


-  m]  ■  -zwi 


oo 

y  (iw  ^  f  ■  rr] 

1=6  '  '  ’  ' 


(5.  28) 


the  samples  of  the  double  expansion  of  k(t,  t)  are  related  to  the  multi¬ 
plier  samples  by 
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FIGURE  5.  5.  Sampling  Expansion  Realization 
of  k(t,  t)  Using  L  ink  Structure . 
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etc . 


VI.  APPLICATIONS  AND  CONCLUSIONS 


Several  examples  of  time-varying  systems  will  be  briefly 
outlined  in  this  chapter.  The  emphasis  of  the  presentation  is  on  the 
application  of  the  methods  that  were  presented  in  previous  chapters 
to  these  examples. 

A.  SATELLITE  COMMUNICATION  SYSTEM 

The  communication  channel  between  two  ground  stations  via 
an  earth  satellite  is  time -varying  because  the  time  delay  and  Doppler 
shift  that  the  receiver  sees  change  in  time  due  to  the  movement  of 
the  satellite.  If  the  satellite  is  active  its  transfer  function  may  be 
time-varying  due  to  satellite  precession,  position  of  solar  cells,  etc. 
For  geometric  simplicity,  assume  that  the  satellite  is  traveling  in  a 
circular  orbit  of  radius  R,  as  shown  in  Figure  6.  1,  and  that  the 
transmitter,  receiver,  and  satellite  are  located  as  indicated  at  angles 
a,  P  and  0,  respectively.  Some  of  the  notation  concerned  with  this 
channel  follows; 

=  angular  velocity  of  satellite, 

9  =  < 

T  =  2ir/c0j^  =  time  for  one  orbit, 

V  =  =  tangential  velocity  of  satellite, 

v^  =  speed  of  light, 

r  =  radius  of  earth. 
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FIGURE  6.  1.  Geometry  of  Satellite  Communication  System. 
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R  =  radius  of  orbit, 

-  time  delay  between  transmitter  and  satellite, 

=  Doppler  shift  between  transmitter  and  satellite, 
u)  =  carrier  frequency. 

The  total  amount  of  delay  between  the  transmitter  and  receiver  is 

A  =  A  +  A,  =  —  .  (6.  1) 

a  b  V 

c 

where  a  and  b  are  the  transmitter-to-satellite  distance  and  satellite- 

to-receiver  distance,  respectively.  These  distances  can  be  computed 

by  the  rule  of  cosines; 

2  2  2 
a  =  r  +R  +2rR  cos  {9+a>  , 

\ 

b  =  +  R^  +  2r  R  cos  .  (6.  2) 


The  Doppler  shift  is  proportional  to  the  component  of  the  velocity  towards 

the  transmitter  or  towards  the  receiver,  and  for  the  channel  of  Fig- 
11 

ure  (6.  2),  a  transmitted  carrier  of  frequency  w  is  received  as  a 
sinusoid  of  frequency  oj  +  W  ,  where  the  Doppler  shift  W  is 

W  =  (-vn,j,  +  vnp^)  ^  .  (6.3) 

c 
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and  the  total  Doppler  shift  becomes 


W 


1  1 
^  sin(0-p)  -  —  sin(0+a) 


(6.8) 


Now  the  K2(t,  w)  system  function  can  be  calculated.  For  a 

.  -n-  tu  t  n-f  )(t- ^ ) 

transmitted  carrier  e  ,  the  satellite  receives  e 

If  the  satellite  H  function  is  H(t,  oj),  the  satellite  output  is  then 


H(t,  w  +  WJe 

3. 


j(cu+W  J(t-A  J 


The  received  signal  becomes  H(t-A,  ,w+W  )  which  for 

O 

v«v^  is  approximately  H(t- A^,  co+W^)  _  Considering 

the  fact  that  the  satellite  first  comes  into  the  line  of  sight  of  the  re¬ 
ceiver  at  time  t^  and  first  goes  out  of  the  line  of  sight  of  the  trans¬ 
mitter  at  time  t^  ,  the  system  function  is 

H(t.A^.c.+W  tp+nT<t<t^+nT  , 

D  3 

K(t,  w)  =  <  (6.  9) 

I  0  otherwise  , 


where  A^,  W^,  W,  and  A  are  functions  of  time  that  have  been  deter¬ 
mined  by  Equations  (6.  1)  through  (6.8). 

For  a  passive  satellite,  the  satellite  transfer  function  is  a 
constant  that  is  close  to  one;  for  a  stably  oriented  satellite,  the  satellite 
transfer  function  will  be  a  time -invariant  repeater  H(w)  .  In  an  un¬ 
stable  mode,  the  axes  of  the  satellite  change  direction  in  time,  and 
thus  the  satellite  receiving  antenna  and  transmitting  antenna  come 
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into  and  out  of  view  with  the  ground  transmitter  and  receiver,  respec¬ 
tively,  causing  a  multiplicative  effect  on  the  satellite  transfer  function. 
Since  the  effect  of  the  receiving  and  transmitting  antennae  must  be 
taken  separately,  the  satellite  transfer  function  is  of  the  form: 

H{t,0j)  =  Q(t)  P(t)  H(co)  ,  (6.10) 

where  a(t)  and  p(t)  may  be  periodic  functions. 

Actually,  except  for  possible  time  variations  in  the  satellite 
system  function,  the  change  in  Doppler  shift  and  time  delay  will  usually 
be  small  compared  with  the  signal  duration,  and  the  over-all  system 
function  can  be  considered  as  fixed  for  signals  of  short  duration.  Numeri¬ 
cal  estimates  of  Doppler  and  of  delay  for  the  typical  parameters, 

Q 

v^  =  3  X  10  m/sec, 
r  =  4000  mi  =  6.4  x  10^  m  , 

R  =  16000  mi  =  25.  6  x  10^  m  , 

T  3  hr  , 

=  Ztt/IOSOO  rad/sec  , 
a  =  60*  , 

P  =  0*  , 

0  =  cos'^  ^  76’  , 

are: 

W  =  -14.8  X  lO'^w  , 
a 

W  =  lO'^u  , 

=  .  094  sec  , 

A  =  .185  sec  .  (6.11) 
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9 

For  a  typical  carrier  frequency  of  4  x  10  cps  ,  the  total  Doppler 
shift  is  40  kc  . 

B.  AIR-TO-GROUND  COMMUNICATION  SYSTEM 

The  signal  received  at  a  ground  station  from  a  plane  or  a  missile 
passing  by  at  high  speed  is  distorted  by  time  delay  and  by  Doppler  shift 
in  frequency.  Under  the  assumption  that  the  plane  is  traveling  at 
velocity  v  in  a  straight  line  at  a  minimum  distance  h  from  the 
ground  station,  the  geometry  of  the  air-to-ground  communication  sys¬ 
tem  is  shown  in  Figure  6.  3. 

If  communication  is  begun  at  time  t^  when  the  missile  is  at  a 
lateral  distance  r^  from  the  station,  the  delay  as  a  function  of  time  is 


FIGURE  6.  3.  Geometry  of  Air-to-Ground  Communication  System. 
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(6.  12) 


ci(t)  . 


^h^+(r^  -  vt)^  ' 


V 

c 


and  is  plotted  in  Figure  6.4. 

To  compensate  for  the  delay  d(t)  ,  one  must  construct  an  inverse 
filter  for  it.  In  Chapter  II  it  was  shown  that  the  inverse  filter  exists 
if  t  -  d(t)  is  invertible.  Figure  6.  5  gives  a  plot  of  t  -  d{t)  versus 
time.  The  derivative  of  t  -  d(t)  is 


^  (t  -  dd))  =  - - j-  .  (6.13) 

[h^  +  (r^  -  vt|^] 

Since  v/v^  <  1  ,  the  right-hand  side  of  Equation  (6.  13)  is  greater 
than  zero  for  all  t,  r^,  and  h: 

^  (t-d(t))  >  0  ;  (6.14) 


therefore  t  -  d(t)  is  a  monotonically  increasing  function  and  its  in¬ 
verse  exists. 

The  Doppler  shift  as  a  function  of  time  is  given  by 

r  '  vt 

W(t)  =  —  w  cos  0  =  ~  5 - - -  .  (6.  15) 

'  V  O  VO  1 

[h^  +  (r^^^  -  vt)^] 

Figure  6.6  shows  this  Doppler  shift  as  a  function  of  time.  The  Doppler 
shift  can  be  corrected  for  by  using  a  voltage  controlled  oscillator  in 
the  receiver.  If  the  oscillator  control  voltage  is  W(t)  ,  the  mixer 
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frequency  will  be  +  W(t)  ,  and  the  intermediate  frequency  will  be 

u,i  -  u^o  • 

C.  SIDE -LOOKING  RADAR 

A  plane  with  a  radar  unit  mounted  on  its  side  can  be  used  for  an 
all-weather  ground  mapping  system  by  flying  parallel  to  the  meridian 
being  mapped  with  the  radar  antenna  facing  the  target  meridian..  The 
resolution  of  the  mapping  is  proportional  to  the  carrier  fr-'quency  of 
the  radar  pulses.  Ideally  the  plane  will  be  held  on  line  without  turning 
or  rolling,  and  the  time  delay  and  Doppler  shift  will  be  constant.  Although 
one  can  fly  a  plane  parallel  to  a  fixed  meridian  at  a  fixed  distance,  the 
roll  of  the  plane  cannot  be  controlled  perfectly.  A  typical  trajectory  of 
receiving  antenna  movement  due  to  wing  flutter,  air  drafts,  etc.  ,  is 
shown  in  Figure  6.7. 

The  time  delay  will  be  essentially  constant,  and  since  the  plane 
velocity  will  be  small  compared  with  tne  speed  of  light  and  V  9^1  ,  the 
time  delay  is  approximately 

d  ^  (6.16) 

c 

Since  the  angle  a  between  the  incident  and  reflected  waves  is  small, 
it  can  be  approximated  by 

dv  ,,  .... 

sm  a  a  «#■  — ,  (6.  17) 
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FIGURE  6.7.  Side-Locking  Radar  System. 

where  v  is  the  plane  velocity.  During  the  surveillance  flight  the 
received  data,  as  well  as  the  data  on  plane  movement,  can  be  recorded 
on  tape.  Afterwards,  a  curve  of  the  angle  between  the  received  wave 
and  the  direction  of  antenna  can  be  computed,  and  the  Doppler  shift, 
which  is  denendent  on  this  angle,  can  be  compensated  for  by  a  voltage 
controlled  oscillator  in  the  receiver  mixer. 


D,  FEEDBACK  CONTROL  SYSTEM 


Feedback  is  often  used  to  control  the  sensitivity  of  a  system  to 
internal  v?,  riations.  If  the  variations  are  large  the  system  may  be 
adaptive  in  that  the  feedback  changes  with  time  to  counteract  the 
changing  system  variations.  If  the  system  function  for  the  plant  is 
known,  it  may  be  possible  to  .ompute  the  system  function  of  the  con¬ 
troller  that  wiii  give  the  desired  over-all  system  function.  For  the 
systeri  shown  in  Figure  6.8,  the  controller  A  is  to  be  chosen  for  a 
given  plan'  B  so  that  the  over-all  system  functiot  will  be  K. 


FIGURE  6.8.  Feedback  Control  System, 


The  mat’"ix  of  the  systeni  function  K  is 

K  (I  BA)"‘  BA 
=  I  -  (I  +  BA)’^ 


(6.  18) 


where  B  nd  A  art  the  matrices  of  systems  B  and  A  .  Equation  (6.  18) 
can  be  i  eavranged  as 

BA  (I  ■  K)‘^  -  I  ,  (6.  19) 
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and  if  B  exists,  then 

A  =  (I  -  K)"^  -  B 


(6.  20) 


If  only  a  quasi-inverse  of  B  with  j  units  of  delay  exists,  then 
DA  =  B'  (I  -  K)"^  -  B’ 
where  B'  is  the  quasi-inverse  of  B  and 


D 


B'  B 


(6.  21) 


(6.  22) 


Since  the  first  j  rows  of  the  left-hand  side  of  Equation  (6.  22)  are  zero, 
the  first  j  rows  of  the  right-hand  side  must  be  zero.  This  will  be  true 
if  the  first  j  rows  of  K  are  zero.  Thus,  for  a  given  system  B  that 
is  quasi-invertible  with  j  units  of  delay,  one  can  obtain  any  specified 
over-all  system  function  K  to  within  j  unit.s  of  delay  by  choosing  the 
appropriate  controlling  network  A  . 

As  a  numerical  example,  take  the  plant  matrix  to  be 


0  0  0 
1  0  0 
2  1  0 
3  2  1 


B  has  the  quasi  -  inve  rse  B'  with  one  unit  of  delay,  where 

"o  0  0  0~ 

B'  -  0100 

0-110 
_0  1-2  1  _ 


(6.  23) 


(6.  24) 
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Hence  K  must  be  chosen  so  that  the  upper  left-hand  element  of 
(I  -  K)  ^  is  one; 


K 


0  0  0  0 
10  0  0 
-110  0 
2-110 


(6.  25) 


It  can  be  verified  by  performing  the  matrix  multiplications  indicated 
by  Equation  (6.  21)  that 


DA  = 


0 

A 


0  0  0  0 
10  0  0 
1  0  0 
_2  -2  1  0_ 


(6.  26) 


and  therefore  the  matrix  of  the  controller  is 


A  - 


10  0  0 
-2100 
2-210 


This  method  is  also  applicable  to  infinite  matrices. 


(6.27) 


E.  A  WHITENING  FILTER 


A  whitening  filter  for  stationary  noise  n(t)  with  a  no.nwhite 

spectrum  S  (w)  is  a  network  with  transfer  function  H(cj)  such  that 
n 


n 


(6.  28) 
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When  n(t)  is  passed  through  the  network  H(uj)  ,  the  spectrum  of  the 
output  noise  n'(t)  is 


S 

n 


(w) 


H(u.) 


(h.  29) 


Thus  the  output  noise  n'(t)  is  wtiite. 

If  the  noise  n(t)  is  nonstationary,  then  the  whitening  filter  may 
be  time- varying,  if  it  exists.  For  example,  if  the  noise  consists  of 
a  Gaussian  pro  :ess  with  mean  zero  and  spectrum  S  (oj)  plus  a  time- 

b 

varying  mean  m(t)  ; 

n(t)  =  +  nn(t)  ,  (b.  30) 

the  whitening  filter  is  a  network  that  subtracts  m(t)  from  the  input 

and  then  passes  n  (t)  through  its  time-invariant  whitening  fiber. 

S 

This  whitening  filter  is  time -invariant  but  contains  a  source  (generator 
of  m(t))  and  a  subtractor.  If  the  noise  n{t)  is  of  the  form 


n(t)  =  n  (t)  f(t)  ,  (6.31) 

the  whitening  filter  is  a  G-separable  network  with  the  multiplier  l/f(t) 

followed  by  the  time -invariant  whitening  filter  of  n  (t)  , 

Generally  the  r  istationary  noise  will  be  characterized  by  its 

autocorrelation  R^(t,T)  .  The  whitening  filter  problem  is  to  find  tl  e 

network  k{t,  t)  for  a  given  R„(t,  t)  such  that  the  output  spectrum  is 

n 

R^,(t  -  r)  “  6(t  -  r)  .  Using  the  noi'  e  output 


n'(t) 


/ 


k(t,  t)  n(T)  dr 


0 


(6.  32) 


-  in  i  • 


the  correlation  function  of  the  output  noise  is  given  by 


II 


R^,(t,  s)  =  II  k(t.  t)  k  (s,  u)  u)  dr  du 


(6.  33) 


The  matrix  approach  can  be  used  by  expanding  'j)  a^tid  the  system 

functions  in  terms  of  the  complete  sets  ^41.^  and  ■ 


k(t.  t)  ^ 


IN 

+j(T) 


k‘*‘(s,  u) 


IN 


R„(t,u)  = 


r  d)  (u)  4^  (r) 
mp  ^m  p' 


m,  p 


(6.  34) 


Substituting  Equations  (6.  34)  into  Equation  (6.  33)  yields  the  expansion 
of  R^.(t,s); 


s)  ^ 


1,  j,  k,  '  ,  m,  p 


"mpj  J  4>,(04^i,(s)4.;(u)4>„,(u)4'j(T)yT)dudT 


1, j,  k,  I 


Vi  '■ij  '•'kl*) 


^  hk  Oil'l+k*'^' 

1.  k 


(6.  35) 
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where 


V  • 

/  a  a,  .  r ,  . 

Z__i  ij  h 


{t.  36) 


Since  5(t-s)  is  not  in  L  ,  the  expansion  of  Equation  (6.  35)  can  be  an 

expansion  of  a  high  thin  pulse  wliich  is  in  and  is  an  approximation 

to  6(t-s)  .  The  coefficients  of  R  ,(t,  s)  are  approximately 

n 


(0  for  i  /  k  , 

1  for  i  =  k  .  (6,  37) 


The  N**  unknowns  a^j  of  the  equations  (6.  37)  are  the  coefficients 

of  the  time-varying  whitening  filter. 

For  real  n(t),  R^(t,  u)  is  symmetric.  Therefore  a  standard 
eigenfunction  approach  can  be  used  to  solve  the  integral  equation  (6.  33). 
Let  be  the  set  of  eigenfunctions  of  u)  , 


\ .  4).(t) 
J  J 


R  (t,  u)  4).(u)  du 
r-  J 


(6.  38) 


Since  the  set  of  eigenfunctions  i  .s  complete,  the  system  functions  can 
be  expanded  a  s 


f  / 


V 


cPjt/; 


(o.  3h) 


lOS- 


where 


aj(t) 


T 

r 


k(t,  t)  4)j(T)  dr 


(6. 40) 


By  using  the  expansion  of  Equation  (6.  39),  Equation  (6.  33)  becomes; 

T  T 


s) 


k*{s,u)  R^(t,u)  du 


?*■"'// 


_ ^  T 

^X.a.(t)  I  k^Cs,  u)  (|)^(u) 


du 


E 


X. .  a  (t)  aT(s) 
J  J  J 


(6.41) 


If  one  first  considers  making  the  output  noise  spectrum  to  be  only 
stationary: 


R^,(t,  s)  =  R(t  -  s) 


(6.42) 


then  a  (t)  is  identified  as  4^  (t)  ,  where  i['  (t)  and  y.  are 

j  J  J  J  J  J 

the  eigenfunction  and  eigenvalue  associated  with  R(t  -  s); 

T 


Vj  4jj(t)  =  R(t  -  s)  i|i.{s)  ds 
0 


(6.43) 


The  filter  given  by  the  expansion  of  Equation  (6.  39)  makes  the  input 
noise  stationary;  a  time-invariant  whitening  filter  in  cascade  with 
k(t,  r)  makes  the  noise  white. 


-  10b- 


One  physical  model  of  this  process  of  whitening  fellows.  White 
stationary  noise  passes  through  some  time-varying  filter  k  (t,  t)  to 
become  nonstationary.  The  whitening  filter  is  essentially  the  right- 
hand  inverse  to  k  (t,  t)  .  Finding  k(t,  t)  from  same 

as  identifying  k'^(t.  t)  from  and  then  constructing  its  right - 

hand  inverse  k(t,  t)  . 

F.  MATCHED  FILTER  TO  A  SIGNAL 
IN  NONSTATIONARY  NOISE 

If  the  whitening  filter  k(t,  t)  has  a  left-hand  inverse  k  (t,  t)  , 
the  nonstationary  noise  n(t)  can  be  considered  as  having  been  generated 
by  passing  white  stationary  noise  through  k  (t,  t)  .  By  using  k  (t,  t) 
as  a  pretransmission  filter,  the  matched  filter  for  a  channel  with  non¬ 
stationary  noise  is  constructed  as  shown  in  Figure  6.9.  This  matched 
filter  has  components  at  both  the  transmitting  and  receiving  ends.  It 
is  desirable,  however,  not  to  have  a  pretransmission  filter  because 
one  would  like  to  transmit  a  standard  signal  and  not  worry  about  time- 
varying  average  and  peak  power  restrictions. 

A  reasonable  detection  scheme  has  the  whitening  filter  followed 

by  a  matthed  filter  to  the  signal  component  of  the  output  of  the  whitening 

filter,  which,  in  turn,  is  a  matched  filter  to  y  (t)  ,  where 

'o 

t 

y  (t)  /  k(t,  t)  x(t)  dr  .  (6.44) 

^o  J 

T 

o 
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FIGURE  6.  10.  Matchc'd  Filter  No.  I  for  Channel  with  Non.stationa r y  Noise. 


Since  y  (t)  depends  on  the  initial  time  of  transmission  ,  the  matched 
^o 

filter  itself  is  time-varying.  In  the  case  where  transmission  will 
occur  only  at  discrete  times  ,  a  bank  of  matched  filters,  each 
matched  to  y.;-.(t)  ,  can  be  used.  Now  one  can  show  that  this  detection 
scheme,  as  given  in  Figure  6.  10,  is  indeed  the  matched  filter  for  a 
channel  with  nonstationary  noise. 

A  filter  f(t,  t)  is  a  matched  filter  to  a  signal  x(t)  if  the  ratio 
of  the  instantaneous  output  power  of  the  signal  component  at  time  t^ 
to  the  average  output  noise  power  at  time  t^  be  a  maximum.  The 
instantaneous  output  signal  power  at  time  t^  is 


P  .(t  ) 


2 


f{t^,  t)  x(t)  dr 


(6.45) 


The  average  output  noise  power  at  time  t^  is 

E  rn'(t  )^]  =  R  ,(t  ,  t  )  =  N(t  ) 

L  o  J  n''  o  o  '  o 


(6.46) 


Also,  the  noise  component  of  the  output  of  f(t,  t)  at  time  t  is 

t 

n'(t)  =  r  f(t,  t)  n(T)  dr 


J  f(t,  t)  n( 


(6.47) 


-oo 


and  the  autocorrelation  of  the  output  noise  is 


t  u 


/  /«., 


t)  f  (u,  r)  Rj^(t,  r)  dr  dr 


(6.48) 


-oo  -oo 
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Under  the  assumption  that  n(t)  is  generated  by  passing  white  stationary 

_  1 

noise  n''(t)  through  a  filter  k  (t.  t),  i.  e. 


n(l)  = 


I 

J  k  ^(t,  r)  n"(T)  dr 


-oo 


R  (t,  r)  becomes 
n 


R  (t,  r)  = 
n 


T  r 


//  k'^T.u)  k  ~^(r,v)  R^,,(u,v)  du  dv 


-oo  -oo 


(6.49) 


(6.  50) 


Since  n"(t)  is  white, 


R^,,(u,  v)  =  6(u-v) 


(6.  51) 


and  Rj^IT,  r)  becomes 

T 

Rn(T>  r)  =  J  k’^(T.  v)  k*'^(r,  v)  dv 
-oo 


(6.52) 


The  average  noise  power  at  time  t^  then  becomes 


t  t  t 
o  o  o 

Rn.(to’^o^^  f  f  f 

-00  -oo  -oo 


-00 


t 

o 

f(to'  'T)  v)  dr 

-oo 


2 


dv 


(6.53) 
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The  ratio  to  be  maximized  is 


Py<‘o> 

Nirr 


O 


t)  x(t)  dr 


t  t 

o  o 


r  r  -1 

f(t  ,  t)  k  (t,  v)  dr  dv 

J  J  ° 


-oo  -oo 


(6.54) 


which  can  be  simplified  by  making  the  change  of  variables: 


f{t.  t)  =  g(t)  ®  k(t,  t) 


(6.  55) 


Thus, 


J"f(t,  t)  k"^(T,  v)dT  = 


v)dT  =  g(t)  «  k{t,  t)  ®k'*(T,  v) 


=  g(t)  ®  [k(t,  t)  ®  k“  (t,  v) 


g(t)  ®  5{t-v)  =  g{t-v) 


{6. 56) 


N(g 


o 

/  dv 


(6.57) 


The  numerator  becomes 


P  (t  )  = 

y  o 


j 

Vo 


t)  x(t)  dr  dv 


(6.  58) 
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but  by  Schwartz's  inequality, 


o  V 


-  j  j  j  ^(v,  T)x(T)dT  dv  .  (6.59) 


-CX3  T 


The  maximum  bound  on  the  ratio  of  Equation  (6.  54)  is  therefore 


-W7  ^ 


o  V 

/  / 

-OO  T 


k(v,  t)  x(t)  dr  dv 


(6. 60) 


This  maximum  occurs  when  g(t)  is  chosen  as 


V 

g(to-v)  =  I  k(v,  t)  x(t)  dr  =  y^  (v) 


(6.61) 


g(t)  =  y^  (t^-t) 


(6.  62) 


The  impulse  response  g(t)  is  the  impulse  response  of  the  matched 
filter  to  y.j.^(t)  .  Considering  the  change  of  variables  of  Equation  (6.  55), 
the  matched  filter  for  a  channel  with  nonstationary  noise  is  seen  to  be 


^(t,  t)  =  y^  ® 


(6.63) 


Equation  (6.63)  represents  the  whitening  filter  cascaded  with  the  matched 
filt-r  to  the  signal  component  of  the  whitening  filter  output. 
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The  maximum  bound  given  by  Equation  (6.  60), 


M(t  ,  T  ) 
o  o 


(V) 


dv 


(6.  64) 


is  a  function  of  both  t  and  t  .  From  the  form  of  M(t  ,  t  )  one  sees 

o  o  o  o 

that  M(t^,  T^)  increases  with  increasing  t^  in  the  same  way  as  in  the 

time-invariant  case.  For  fairly  large  t^  ,  M(t^,  T^)  is  essentially  the 

energy  in  y  (t)  .  This  suggests  that  optimization  of  the  signal  trans- 
^o 

mission  time,  for  a  fixed  signal  x(t)  ,  be  done  s  j  that  the  signal  is 

transmitted  at  a  time  for  which  the  output  of  the  whitening  filter 

y.j.  (t)  has  maximum  energy.  This  corresponds  to  choosing  t  at  a 
o 

time  when  the  noise  power  is  low,  in  some  sense.  The  optimization  of 

should  be  done  in  conjunction  with  optimization  of  the  shape  of  the 

signal  x(t)  for  a  fixed  transmission  time  or  for  a  given  a  priori 

distribution  of  cost  function  over  t  . 

o 


1.  -Optimum  Signal  Design  for  Slowly  Varying  Noise 
For  the  case  where  the  duration  of  the  signal  x(t)  is  short 
enough  so  that  the  noise  has  fairly  constant  statistics  over  the  duration 
of  the  signal,  the  noise  can  be  approximated  in  a  stepwise  manner.  The 
noise  can  be  considered  as  stationary  on  the  time  intervals  with 

corresponding  spectral  density  |Nj^(w)J  ,  where  ^  is  the  time  inter¬ 
val  of  interest.  Then  the  time -varying  whitening  filter  on  the  time 
interval  becomes  simply  the  time  invariant  whitenin,^  filter  'W'j^(cj)  , 
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where 


Wj^(u)) 


1 


(6.  65) 


The  optimum  signal  maximizes  the  quantity  M(t^,  T^)  .  For 
large  t^  and  ^k^  is  approximately 


M(oo,  T^) 


|x{a3) 


Wj^(co) 


dco 


(6.  66) 


M(oo,  Tj^)  is  maximized  by  taking 
X{a))  =  a  Wj^(co)  e 


(6.67) 


where  a  is  a  constant,  and  then  by  choosing  the  index  k^  for  which 

oo 

M{oo,  Tj^)  =  y  ]Wj^(u>)j^  du  (6.68) 

-oo 

is  a  maximum.  Equation  (6.  67)  gives  the  optimum  signal  waveshape, 

and  is  the  optimum  time  interval  during  which  the  signal  should 

o 

be  transmitted.  The  value  of  k^  for  which  Equation  (6.  68)  is  a  maximum 
corresponds  to  the  time  interval  A,  when  the  noise  power  is  lowest. 

It  should  be  mentioned  in  conjunction  with  signal  optimization 
that  there  is  essentially  no  difference  between  the  first  and  second 
matched  filters,  as  shown  in  Figures  6.9  and  6.-0..  If  x^(t-T)  is  the 
optimum  signal  for  the  second  matched  filter,  then 
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is  the  corresponding  optimum  signal  for  the  first  matched  filter. 

If  the  signal  for  the  second  filter  x^(t-T)  is  not  optimum  and 
if  M{oo,  t)  is  greater  for  the  first  matched  filter  system,  when  ax^(t-T) 
is  its  input  (where  the  constant  a  is  chosen  to  that  the  transmitter  of 
either  matched  filter  has  identical  average  power),  then  it  is  obvious 
that  the  output  of  the  pretransmission  filter 

t-T 

(t-r)  =  J  k  ^(t-T,  u)  x^(u-t)  du  (6.70) 

T 

is  a  better  signal  to  use  for  the  second  matched  filter  system. 


G.  CONCLUSIONS 

In  this  investigation  a  number  of  methods  were  developed  for 
analyzing  and  synthesizing  time-varying  systems.  The  characterization 
of  time-varying  systems  was  completed  by  the  definition  of  the  K  system 
functions  and  the  complimentary  system  functions.  The  relationships 
among  the  system  functions  were  clarified,  and  the  physical  interpre¬ 
tation  of  the  K  system  functions  as  impulse  responses  was  seen  to  be 
useful  in  finding  the  system  function  for  a  cascaded  system.  The  time- 
frequency  duality  relationships  among  the  system  functions  were  noted, 
and  the  introduction  of  physical  variables  enlarged  the  concept  of  duality 
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so  that  knowing  one  relationship  becomes  equivalent  to  knowing  four 
relationships  instead  of  two. 

The  terminated  multiplier  structure  was  shown  to  be  separable 
for  an  exponential  multiplier  or  for  a  periodic  multiplier  when  one  of 
the  terminating  networks  has  a  periodic  frequency  response.  The 
analysis  of  the  terminated  multiplier  was  applied  to  a  modulation- 
demodulation  system. 

The  system  functions  were  expanded  in  a  double  series  in  terms 
of  the  complete  set  ^4)^(x)  4^^ (y)^,  as  in  a  double  sampling  series.  Net¬ 
works  were  presented  to  evaluate  the  coefficients  of  these  expansions. 

By  using  the  system  function  expansion,  the  input-output  equation  was 
shown  to  be  reducible  to  a  matrix  relationship. 

The  conditions  for  the  invertibility  of  a  time-varying  delay  system 
were  found,  and  the  general  inversion  problem  was  discussed  from  the 
matrix  point  of  view.  The  known  theorems  on  the  existence  of  inverses 
and  quasi-inverses  were  presented  and  were  extended  for  the  recovera¬ 
bility  of  a  signal  of  finite  duration.  The  application  of  the  double  series 
to  the  integral  eigenvector  equation  reduced  it  to  a  matrix  eigenvector 
equation.  It  was  suggested  that  a  judicious  choice  of  expansion  functions 
could  lead  to  faster  convergence  than  Fredholm's  method. 

Based  on  the  double  expansion,  a  method  was  presented  for  syn¬ 
thesizing  system  function  by  a  parallel  combination  of  separable  networks 
where  one  has  some  control  over  both  the  networks  and  the  multiplier. 

By  considering  the  double  series  as  a  bilinear  form,  a  unique  realization 
was  found  in  which  a  resistive  cross-coupling  network  connected  the 
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networks  to  the  multipliers  so  that  only  N  networks  and  N  multipliers 
were  used  to  achieve  an  term  expansion.  A  synthesis  scheme 

using  the  link  structure  and  based  on  the  sampling  expansion  was  also 
presented. 

The  system  function  for  a  satellite  communication  was  found,  and 
correction  for  unwanted  Doppler  shift  and  time  delay  in  an  air-to-ground 
communication  system  and  in  a  side-looking  radar  system  were  suggested. 
The  problem  of  finding  a  whitening  filter  for  nonstationary  noise  was 
formulated.  The  matched  filter  for  a  channel  with  nonstationary  noise 
was  shown  to  consist  of  a  whitening  filter  followed  by  a  matched  filter 
to  the  signal  component  of  the  output  of  the  whiter.'P.g  fiitcr.  Because 
the  v'hitening  filter  is  time -varying,  the  signal  component  of  its  output 
is  different  for  different  input  signal  starting  times  and  thus  the  matched 
filter  varies  with  time .  When  the  noise  varies  slowly  enough  to  appear 
constant  over  the  time  duration  of  the  signal,  the  optimum  signal  is 
the  impulse  response,  delayed  by  t  ,  of  a  constant  whitening  filter. 

The  transmission  time  r  is  chosen  at  a  time  when  the  noise  power  is  low. 
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APPENDIX.  SAMPLING  THEOREMS 


A.  SAMPLING  THEOREM  IN  ONE  DIMENSION 


Let  f(t)  have  a  Fourier  transform  F(u))  where  F{w)  is  zero 
outside  the  band  lu]  <  2trB  .  In  this  band,  F(to)  can  be  expanded  in  a 
Fourier  series: 


I. 


for  o)  <  ZttB 


F((u)  = 


for  u)  >  2itB 


(A.  1) 


where 


^  f 

ttB  J 


ikw 

Tr“ 

F(oj)  e  dw 


-i- 

IB  \Zb) 


(A.  2) 


Thus, 


-no  V  / 


for  w  <  2t7B  , 


for  w  >  2ttB 


(A.  3) 
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and 


f(t) 


^  2ttB 


dw 


-CX) 


-ZttB 


oo 

I 

-oo 


sinZTrBjt-^ 
2B 


ZttB 


('  ■  «) 


(A.  4) 


This  last  equation  was  viewed  by  Middleton  as  an  interpolation 
formula  with  the  weighting  function  (sin  2TTBt)/2TTBt  .  He  postulated  the 
following  general  interpolation  formula  in  which  f(t)  and  g(t)  are 
assumed  to  be  Fourier  transformable: 
oo 

f(t)  =  g(t  -  V  • 

-oo 


Equation  (A.  3)  can  be  rewritten  as 


f(t) 


oo  on 

■I  / 


f(T)  g(t-T)  6{t  -  tj^)  dT 


-OO  -oo 


(A.  6) 


and  by  reversing  the  order  of  summation  and  integration, 


oo 


oo 


f(t)  = 


I 


f(T)  g(t  -  t) 

-OO  -oo 


(A.  7) 


The  impulse  train  can  be  expanded  in  the  Fourier  series: 


5(t  -  tj^)  - 


-oo 


oo 

-oo 


Zuikt 


(A.  8) 
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where  =  kT  .  Now  f(t)  is  seen  to  be  a  sum  of  convolutions  of  g{t)/T 
and  f(t)  e  ^  therefore  the  Fourier  transform  of  f(t)  becomes 


oo 


F(co) 


G(to) 


Z"(“ 

-oo 


(A.  9) 


If  one  ,.iiooses  G((jj)  in  such  a  way  that  Equation  (A.  9)  is  an  identity, 
then  Equation  (A.  5)  will  also  be  an  identity  and  g{t)  will  be  a  suitable 
interpolation  function.  Equation  (A.  9)  is  an  identity  for  any  F(w) 
limited  to  the  band  |lj|  <  ZttB  if 


T 


7E 


(A.  10) 


and 


for 


w  < 


G(u)  = 


0  for 


Zirk 


ZttB 


ZttB  <  w|  <  -^  +  ZttB  ,  fork=l,  Z, 


(A.  11) 


If  T  -  l/Z  B  and  F(oj)  =  0  at  only  a  countable  number  of  points  in  the 
band  jwj  <  ZttB  ,  then  the  interpolation  function  g(t)  is  unique  because 


2B 


|w|  <  ZttB 


GM  = 


for  w  >  ZttB 


(A.  IZ) 


except  at  a  countable  number  of  points,  and  thus 


-IZO- 


-2ttB 


/  »■' 


sin  Z-trSt 
ZirBt 


(A.  13) 


Note  that  if  the  function  is  sampled  at  faster  than  l/2B  seconds, 


on  the  intervals 


^  +  ZttB  <  w  <  -  2ttB  for  k  =  0,  1,  2, 


(A.  14) 


F rom  Equation  (A.  9)  it  is  seen  easily  that  G(co)  is  arbitrary  on  these 
intervals.  For  a  particular  F(a))  ,  these  intervals  are  part  of  the  total 


uu 


=  0  ■  T  < 


on  which  G(a))  is  arbitrary.  For  example,  let 


T  for  |w|  <  2ttB 


G(w)  =  \  a  for  ZttB  <  ]w|  <  ^  -  2ttB 


otherwise 


(A.  15) 


in  which  case 


1  sin  ZirBt 

g(t)  =  (T  -  a)  - — -  +  a 


lA.  16) 


-121- 


Whereas  the  interpolation  function  of  Equation  (A.  13)  when  shifted  by 
tj^  is  orthogonal  and  g(t  -  tj^)  is  zero  at  the  other  sampling  times 
tj(j  /  0)  ,  and  thus  a  truncated  expansion  must  agree  with  f(t)  at  the 
sampling  time  tj^  ,  the  function  of  Equation  (A.  16)  when  shifted  by  tj^ 
is  not  orthogonal,  and  g(t  -  tj^)  may  be  nonzero  at  other  sampling 
times  tj(j  4  •  Therefore  a  truncated  expansion  would  not  necessarily 

agree  with  f(t)  at  the  sampling  times  tj^  . 

5 

Petersen  and  Middleton  used  the  arbitrariness  of  the  function 
g(t)  as  an  essential  feature  of  their  extension  of  the  sampling  theorem 
to  Euclidean  N-space. 


B.  THE  SAMPLING  THEOREM  IN  EUCLIDEAN  N-SPACE 

Consider  the  function  f(x)  =  f(x^,  x^,  ....  x^)  whose  F ourier 
transform  F(d)  exists  as 

F{w)  =  F(w^,a;2-  •  • -“J  =  /  dx  .  (A.  17) 

X 

F{w)  is  said  to  be  "wave-number  limited"  if  it  vanishes  outside  of 
a  finite  subspace  R  of  "wave-number  space"  In  this  case  one 

can  define  a  basis 

("j)  "  ("r'^2'  •  •  ' ’“^n}  ’ 

in  terms  of  which  the  lattice  sampling  points  are  expressable  as 

^  A  +  ^  +  .  .  .  +  Z  V  , 

[ZJ  1  1  2  Z  n  n 
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^  I’  ^  Z'  ‘  ^  n  ~  ±2,  ... 


(A.  19) 


It  is  desirable  to  find  the  conditions  on  g(t)  which  make  it  an 
interpolation  function  such  that  f(5i)  is  expandable  in  the  series 


f(x)  = 


)  g(x  -  trn) 


m 


(A.  20) 


By  using  the  N-dimensional  Dirac  delta  function,  Equation  (3.  22)  can 
be  written: 


f(x) 


-I 


f(p)  g(x  -  p)  -  vj-^j)  dp 

w 


(A.  21) 


It  can  be  shown  that 


I 

W 


5(p  -  ygi  = 


1 

Q  ® 


•ip  u, 


(A.  22) 


[m] 


where  Q  is  the  hypervolume  of  a  parallelepiped  with  edges  v.  and  TT. 


related  by 


V.  •  =  2tt6., 

J  k  jk 


(A.  23) 


where  6^^  is  the  Kronecker  delta.  By  using  Equation  (A.  22),  Equa¬ 
tion  (A.  21)  becomes 


f(x)  = 


fn^)  dp 


J  f(p)  e 

[m]  X 


(A.  24) 
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As  in  the  one -dimensional  case,  Equation  (A.  Z4)  is  recognized  as  a 
sum  of  convolutions.  Taking  the  Fourier  transform  of  both  sides  yields 


F(„ 


(A.  25) 


Conditions  on  G(u)  and  Uj^  for  which  Equation  (A.  25),  and  subsequently 
Equation  (A,  20),  are  identities  follow; 

1.  The  vectors  uj^  must  be  larige  enough  and.  so  oriented  that 
the  shifted  spectra  do  not  overlap. 


2.  Let 


Q  fo  r  lo'  6  R  , 


0  f  o  r  w  e  R 


(A.  26) 


where  Rp  ,  is  the  subset  R  shifted  by  the  vector  u 


to  to  -  Uc  -t  c  R 


(A.  27) 


R  is  the  subset  on  which  F(to  +  u^  j)  may  be  nonzero.  For  any 
F(to)  which  vanishes  outside  R,  G(w)  is  arbitrary  on  the  compliment 


of  the  set 


n  (  U  R_ 


G(a))  will  be  unique  if 


R  r  q  =  ^ 
[it^  ^ 


(A.  28) 
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but  because  of  the  shape  of  R,  one  may  not  be  able  to  choose  the  vectors 


"uj^y  such  that  Equation  (A.  28)  is  satisfied.  If  not,  G(u))  will  be  arbi- 


( 

trary  over  some  nonzero  subset  of  .  In  the  one -dimensional  case, 
however,  one  could  always  choose  T  =  1/2B  (T  is  the  length  of  the 
vector  u^)  in  such  a  way  that  the  domains  of  F((jo  +  2iTk/T)  covered 
the  set  f2  =  (-00,00)  and  G{w)  was  unique. 

The  N-dimensional  sampling  theorem  can  now  be  stated:  A 
function  f(x)  whose  Fourier  transform  v£i.nishes  outside  of  a 

finite  subset  R  of  wave-number  space  can  be  reproduced  from 
its  sample  values  taken  over  a  lattice  of  points  ‘  ^n'^n^ 


for  I  I  2^,  I  0,±1,±2,.,.  where  the  vectors  ^  are  chosen 

to  assure  nonoverlapping  of  the  subsets  R  where 

the  set  R  shifted  by  the  vector  u  and  v.  •  u,  =  2it6.,  . 

■'  m  j  k  JK 

In  the  case  where  R  is  a  parallelepiped  centered  at  the  origin, 
a  particularly  simple  interpolation  function  results: 


N 


g(x)  = 


k=l 


1  _:k 

sin  rr-  u,  •  X 

2  k 


(A.  29) 


1  ""k  ' 


If  R  is  rectangular  and  centered  at  the  origin  and  Uj^  is  chosen 
th 

in  the  direction  of  the  k  unit  vector,  then 


g{x) 


""k  ^k 


I  ''k^'k 


(A.  3C) 


Equation  (A.  30)  is  the  interpolation  function  that  can  be  considered  the 
simplest  extension  from  one  to  N  dimensions.  Actually  this  interpolation 
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function  can  be  used  to  reconstruct  any  function  f(^  whose  Fourier 
transform  vanishes  outside  of  an  irregularly  shaped  finite  region 

R'  by  choosing  a  rectangular  region  R  centered  at  the  origin  which  is 
large  enough  to  include  R'  .  The  conditions  of  the  theorem  are  satisfied 
for  the  larger  region  R  . 

Although  the  simplicity  of  the  sampling  function  of  Equation  (A.  30) 
makes  it  especially  useful,  it  should  be  mentioned  that  choosing  those 
lattice  vectors  may  lead  to  a  relatively  inefficient  sampling  lattice. 


An  effective  sampling  lattice  is  one  in  which  the  vectors 


chosen  to  "pack"  the  spectra 


(^) 


are 


as  close  as  possible  to 


each  other  without  overlapping,  thus  assuring  that  the  least  number  of 
samples  per  unit  hypervolume  in  X  space  are  needed.  For  example, 
in  one  dimension  for  T  =  1/2B  the  spectra  F(co  +  Zirk/T)  are  adjacent. 
This  sampling  time  is  the  slowest  possible;  thus  the  least  number  of 
samples  per  unit  time  are  required. 
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